-- Logs begin at Tue 2022-03-08 19:03:51 UTC, end at Tue 2022-03-08 20:36:31 UTC. -- Mar 08 19:38:31.394616 dv-cinder-830093-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 19:38:31.404193 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 19:38:31 2022] *** Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: nodename: dv-cinder-830093-3-iscsi Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: machine: x86_64 Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: clock source: unix Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: pcre jit disabled Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: detected number of CPU cores: 4 Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: current working directory: / Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: detected binary path: /usr/bin/uwsgi-core Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: your processes number limit is 47680 Mar 08 19:38:31.406311 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: your memory page size is 4096 bytes Mar 08 19:38:31.406985 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: detected max file descriptor number: 2048 Mar 08 19:38:31.406985 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: lock engine: pthread robust mutexes Mar 08 19:38:31.406985 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: thunder lock: enabled Mar 08 19:38:31.406985 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 19:38:31.406985 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 19:38:31.451210 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: Python main interpreter initialized at 0x5575400019c0 Mar 08 19:38:31.451210 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: python threads support enabled Mar 08 19:38:31.451210 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: your server socket listen backlog is limited to 100 connections Mar 08 19:38:31.451210 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: your mercy for graceful operations on workers is 90 seconds Mar 08 19:38:31.451604 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 19:38:31.451683 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: *** Operational MODE: preforking *** Mar 08 19:38:31.451882 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: *** uWSGI is running in multiple interpreter mode *** Mar 08 19:38:31.451882 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: spawned uWSGI master process (pid: 108948) Mar 08 19:38:31.452093 dv-cinder-830093-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 19:38:31.453181 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: spawned uWSGI worker 1 (pid: 108949, cores: 1) Mar 08 19:38:31.453181 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: spawned uWSGI worker 2 (pid: 108950, cores: 1) Mar 08 19:38:31.453181 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 19:38:33.310762 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:38:33.310762 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: from cryptography.utils import int_from_bytes Mar 08 19:38:33.311436 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:38:33.311436 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: from cryptography.utils import int_from_bytes Mar 08 19:38:33.314899 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:38:33.314899 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: from cryptography.utils import int_from_bytes Mar 08 19:38:33.315374 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:38:33.315374 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: from cryptography.utils import int_from_bytes Mar 08 19:38:35.889033 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:38:35.889573 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:38:35.889785 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:38:35.889936 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:38:35.890336 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:38:35.890451 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:38:35.890451 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:38:35.890619 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:38:35.890752 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.890893 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:38:35.891077 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.891184 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:38:35.891429 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.891573 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.891762 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.891859 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.892035 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.892141 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.892377 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.892495 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.892699 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.892795 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.893018 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.893126 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.893342 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.893440 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.893600 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.893731 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.893914 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.894062 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.894237 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830093-3-iscsi {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.894335 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.894559 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.894660 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.894866 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.894960 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830093-3-iscsi {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.895171 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.895259 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.895486 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.895584 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.895789 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.895877 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.896107 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.896195 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.896464 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.896553 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.896790 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.896992 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.897097 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898119 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898268 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898391 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898480 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898561 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898688 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898782 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898883 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.898972 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899053 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899131 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899204 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899290 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899411 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899531 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899732 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.899855 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.900044 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.900162 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.900402 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.900613 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830093-3-iscsi {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.900743 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.900931 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.901143 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830093-3-iscsi {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.901235 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.901465 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.901642 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.901784 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.901945 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.902100 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.902255 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.902515 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.902625 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.902825 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.902925 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.903140 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.903247 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.903463 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.903552 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.903788 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.903881 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.904096 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.904184 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.904434 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.904538 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.904757 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.904847 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.905058 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.905153 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.905364 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.905458 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.905669 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.905766 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.905979 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.906066 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.906280 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.906367 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.906584 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.906689 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.906834 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.906922 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.907137 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.907226 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.907419 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.907515 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.907730 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.907817 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908060 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908147 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908324 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908415 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908578 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908720 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908896 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.908986 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.909214 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.909303 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.909519 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.909613 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.909825 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.909929 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.910131 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.910218 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.910436 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.910525 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.910740 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.910841 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.911044 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.911133 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.911351 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.911446 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.911654 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.911741 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.911959 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.912047 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.912270 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.912388 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.912610 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.912702 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.912916 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.913002 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.913236 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.913336 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.913541 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.913635 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.913861 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.913947 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.914166 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.914268 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.914496 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.914584 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.914807 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.914894 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.915111 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.915199 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.915428 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.915517 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.915747 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.915836 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.916052 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.916147 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.916404 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.916509 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.916710 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.916798 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917019 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917121 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917329 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917418 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917642 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917738 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917890 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.917992 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.918191 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.918291 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.918493 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.918588 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.918807 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.918920 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.919110 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.919205 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.919413 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.919502 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.919717 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.919806 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.920016 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.920104 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.920338 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.920427 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.920642 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.920732 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.920943 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.921028 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.921248 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.921380 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.921555 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.921643 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.921859 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.921945 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.922163 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.922264 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.922466 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.922552 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.923022 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.923110 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.923330 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.923447 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.923639 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.923748 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.923941 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.924044 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.924244 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.924369 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.924571 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.924661 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.924875 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.924962 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.925182 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.925287 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.925485 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.925572 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.925789 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.925887 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.926100 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.926193 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.926403 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.926531 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.926708 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.926796 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.927018 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.927112 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.927323 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.927410 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.927627 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.927714 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.927942 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.928037 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.928241 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.928367 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.928572 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.928666 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.928876 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.928972 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.929181 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.929275 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.929487 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.929581 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.929790 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.929889 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.930093 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.930181 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.930395 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.930485 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.930698 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.930792 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.931000 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.931087 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.931302 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.931396 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.931602 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.931699 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.932457 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.932548 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.932765 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.932853 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.933079 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.933167 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.933391 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.933508 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.933697 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.933796 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.934011 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.934135 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.934315 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.934412 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.934638 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:38:35.934733 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.934979 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.935081 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.935290 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.935389 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.935620 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.935727 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.935944 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.936038 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.936260 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.936375 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.936596 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.936713 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.936910 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.937006 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.937232 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.937328 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.937540 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.937644 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.937849 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.937951 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.938158 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.938259 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.938471 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.938566 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.938784 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.938878 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.939102 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.939198 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.939416 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.939531 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.939731 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.939827 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.940048 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.940144 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.940380 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.940521 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.940692 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.940794 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.941010 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.941109 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.941327 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.941422 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.941635 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.941730 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.941966 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.942059 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.942278 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.942370 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.942603 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.942700 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.942924 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.943020 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.943243 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.943339 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.943552 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.943654 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.943860 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.943965 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.944168 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.944264 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.944512 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.944624 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.944824 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.944927 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.945149 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.945252 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.945601 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.945704 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.945793 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.945884 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.946070 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.946159 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.946380 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.946560 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.946691 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.946790 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.947003 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.947089 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.947318 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.948179 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.948282 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.948392 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.948562 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.948650 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.948876 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.948975 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.949195 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.949289 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.949510 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.949596 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.949820 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.949914 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.950131 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.950220 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.950434 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.950524 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.950740 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.950828 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.951047 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.951210 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.951355 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.951494 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.951631 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.951778 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.951927 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.952066 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.952232 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.952359 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.952575 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.952678 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.952911 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.952997 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.953214 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.953358 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.953525 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.953624 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.953833 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.953929 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.954144 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.954240 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.954449 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.954550 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.954758 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.954846 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.955065 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.955167 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.955368 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.955476 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.955679 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.955773 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.955984 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.956071 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.956314 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.956418 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.956629 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.956729 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.956933 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.957021 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.957236 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.957331 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.957550 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.957639 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.957855 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.957942 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.958162 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.958258 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.958471 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.958567 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.958780 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.958867 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.959100 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.959193 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.959411 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.959505 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.959719 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.959815 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.960038 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.960131 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.960372 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.960465 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.960684 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.960783 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.961006 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.961095 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.961326 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.961416 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.961638 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.961734 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.961940 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.962028 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.962248 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.962336 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.962550 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.962649 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.962853 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.962942 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.963181 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.963268 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.963490 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.963584 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.963826 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.963923 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.964088 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.964177 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.964414 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.964506 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.964727 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.964857 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.965035 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.965217 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.965341 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.965650 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.965753 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.965975 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.966236 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.966333 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.966578 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.966761 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.966884 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.967191 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.967322 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.967537 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.967754 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.967846 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.968180 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.968368 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.968540 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.968861 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.968949 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.969183 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.969496 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.969582 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.969814 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.970111 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.970201 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.970423 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.970517 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.970736 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.970824 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.971047 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.971136 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.971366 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.971454 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.971677 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.971779 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.971997 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.972092 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.972327 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.972432 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.972654 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.972753 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.972967 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.973063 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.973286 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.973381 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.973594 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.973697 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.973909 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.973997 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.974234 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.974320 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.974550 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.974650 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.974873 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.974961 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.975180 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.975268 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.975488 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.975630 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.975804 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.975892 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.976114 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.976202 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.976448 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.976550 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.976759 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.976848 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.977070 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.977158 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.977385 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.977479 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.977692 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.977778 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.977999 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.978091 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.978307 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.978396 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.978652 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.978775 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.978978 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.979291 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.979388 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.979610 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.979703 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.979920 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.980008 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.980241 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.980353 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.980573 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.980672 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.980892 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.980983 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.981195 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.981284 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.981508 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.981603 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.981839 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.981926 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.982154 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.982250 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.982463 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.982558 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.982773 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.982861 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.983079 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.983166 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.983387 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.983484 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.983693 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.983788 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.984004 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.984093 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.984340 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.984432 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.984632 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.984731 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.984937 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.985024 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.985250 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.985338 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.985559 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.985697 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.985864 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.985951 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.986166 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.986253 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.986475 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.986575 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.986786 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.986872 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.987089 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.987178 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.987393 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.987483 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.987704 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.987793 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.988015 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.988101 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.988343 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.988433 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.988669 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.988759 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.988978 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.989064 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.989281 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.989369 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.989585 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.989678 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.989892 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.989980 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.990198 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.990292 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.990500 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.990588 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.990806 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.990920 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.991111 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.991206 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.991441 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.991527 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.991747 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.991847 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.992050 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.992139 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.992385 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.992476 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.992698 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.992797 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.993006 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.993092 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.993318 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.993405 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.993626 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.993727 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.993936 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.994024 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.994777 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.994874 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.995094 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.995193 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.995401 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.995487 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.995712 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.995807 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.996021 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.996109 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.996349 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.996440 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.996659 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.996758 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.996963 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.997098 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.997275 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.997398 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.997583 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.997680 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.997890 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.998164 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.998252 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.998486 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.998573 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.998802 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.998899 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.999120 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.999367 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.999454 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.999697 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:35.999799 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.000010 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.000098 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.000346 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.000449 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.000667 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.000765 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.000985 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.001079 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.001315 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.001416 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.001629 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.001741 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.001935 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.002031 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.002247 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.002336 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.002554 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.002655 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.002859 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.002993 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.003161 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.003248 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.003468 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.003554 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.003769 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.003865 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.004072 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.004164 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.004398 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.004501 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.004704 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.004862 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005003 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005090 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005305 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005394 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005606 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005721 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005908 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.005994 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.006216 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.006309 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.006517 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.006606 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.006818 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.006904 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.007119 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.007206 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.007421 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.007514 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.007732 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.007820 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.008035 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.008129 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.008370 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.008463 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.008678 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.008766 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.009020 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.009108 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.009325 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.009415 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.009637 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.009732 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.010503 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.010610 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.010812 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.010913 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.011120 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.011209 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.011423 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.011519 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.011734 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.011829 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.012045 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.012132 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.012377 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.012480 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.012692 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.012781 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.012999 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.013087 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.013306 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.013394 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.013603 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.013689 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.013904 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.014029 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.014211 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.014299 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.014515 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.014601 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.014821 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.014908 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.015124 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.015213 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.015427 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.015520 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.015727 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.015813 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.016034 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.016129 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.016362 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.016451 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.016666 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.016766 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.016971 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.017058 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.017271 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.017356 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.017573 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.017668 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.017873 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.017961 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.018180 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.018268 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.018480 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.018580 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.018788 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.018874 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.019087 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.019189 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.019389 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.019495 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.019688 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.019775 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.019993 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.020080 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.020329 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.020434 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.020617 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.020711 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.020927 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.021015 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.021232 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.021322 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.021534 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.021620 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.021837 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.021925 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.022144 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.022234 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.022445 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.022535 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.022748 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.022836 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.023055 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.023142 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.023362 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.023458 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.023668 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.023765 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.023969 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.024056 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.024274 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.024383 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.024600 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.024714 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.024903 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.024990 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.025203 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.025289 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.025528 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.025625 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.025831 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.025924 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.026134 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.026221 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.026434 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.026531 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.026737 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.026831 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.027042 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.027128 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.027347 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.027450 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.027655 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.027743 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.027958 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.028046 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.028260 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.028383 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.028584 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.028672 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.028923 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.029011 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.029226 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.029315 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.029557 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.029644 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.029868 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.029959 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.030179 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.030274 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.030480 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.030567 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.030791 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.030877 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.031100 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.031193 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.031409 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.031496 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.031711 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.031808 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.032014 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.032101 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.032338 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.032427 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.032651 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.032752 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.032951 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.033040 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.033253 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.033341 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.033572 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.033738 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.033878 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.033975 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.034187 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.034273 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.034497 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.034594 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.034809 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.034898 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.035120 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.035207 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.035419 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.035508 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.035725 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.035815 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.036034 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.036125 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.036362 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.036453 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.036672 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.036760 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.036983 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.037069 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.037288 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.037376 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.037596 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.037690 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.037903 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.037990 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.038212 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.038302 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.038517 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.038604 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.038819 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.038918 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.039128 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.039223 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.039435 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.039520 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.039736 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.039837 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.040042 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.040136 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.040376 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.040466 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.040682 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.040788 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.040992 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.041132 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.041319 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.041448 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.041627 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.041762 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.041930 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.042070 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.042359 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.042448 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.042672 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.042761 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.042985 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.043072 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.043295 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.043407 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.043603 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.043700 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.043910 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.044010 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.044227 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.044364 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.044572 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.044676 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.044877 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.044973 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.045236 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.045330 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.045545 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.045641 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.045857 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.045947 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.046185 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.046287 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.046489 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.046583 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.046794 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.046880 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.047101 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.047198 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.047423 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.047518 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.047989 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.048077 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.048308 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.048410 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.048617 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.048737 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.048941 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.049057 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.049248 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.049366 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.049568 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.049782 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.049980 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.050095 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.050291 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.050408 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.050595 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.050732 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.051008 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.051097 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.051321 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.051410 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.051634 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.051722 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.051956 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.052045 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.052265 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.052417 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.052612 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.052778 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.052916 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.053005 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.053230 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.053318 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.053540 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.053630 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.053846 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.053934 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.054172 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.054268 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.054484 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.054591 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.054800 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.054893 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.055105 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.055197 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.055429 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.055523 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.055751 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.055844 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.056066 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.056168 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.056411 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.056505 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.057300 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.057404 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.057614 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.057716 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.057923 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.058015 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.058237 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.058328 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.058550 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.058655 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.058862 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.058974 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.059164 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.059255 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.059474 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.059566 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.059778 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.059870 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.060083 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.060175 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.060416 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.060509 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.060723 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.060813 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.061029 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.061119 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.061338 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.061429 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.061648 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.061739 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.061951 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.062042 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.062321 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.062418 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.062582 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.062690 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.062887 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.062988 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.063196 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.063286 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.063510 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.063606 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.063837 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.063995 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.064122 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.064212 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.064452 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.064555 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.064763 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.064880 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.065069 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.065156 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.065373 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.065468 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.065677 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.065776 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.065981 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.066069 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.066323 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.066438 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.066628 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.066729 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.066947 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.067036 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.067278 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.067370 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.067598 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.067711 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.067907 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.068006 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.068229 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.068345 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.068566 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.068665 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.068873 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.068962 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.069186 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.069283 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.069493 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.069583 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.069796 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.069891 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.070099 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.070197 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.070405 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.070493 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.070706 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.070793 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.071009 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.071111 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.071311 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.071400 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.071616 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.071705 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.071917 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.072014 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.072217 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.072324 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.073113 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.073208 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.073425 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.073528 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.073727 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.073816 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.074031 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.074119 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.074345 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.074433 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.074650 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.074756 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.074953 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.075047 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.075254 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.075344 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.075597 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.075685 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.075900 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.075989 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.076219 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.076326 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.076561 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.076693 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.076877 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.076965 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.077193 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.077290 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.077503 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.077591 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.077817 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.077928 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.078131 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.078230 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.078441 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.078528 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.078752 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.078848 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.079061 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.079193 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.079370 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.079466 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.079683 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.079779 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.079993 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.080081 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.080340 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.080540 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.080630 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.080869 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.080961 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.081187 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.081275 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.081503 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.081742 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.081832 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.082070 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.082159 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.082384 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.082473 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.082698 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.082791 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.083010 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.083100 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.083320 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.083415 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.083629 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.083730 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.083939 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.084028 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.084249 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.084356 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.084584 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.084675 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.084894 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.084983 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.085222 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.085371 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.085540 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.085627 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.085857 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.085953 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.086175 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.086273 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.086492 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.086580 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.086806 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.086895 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.087120 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.087211 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.087440 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.087530 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.087757 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.087852 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.088651 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.088764 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.088955 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.089046 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.089270 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.089369 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.089585 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.089673 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.089900 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.089999 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.090209 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.090357 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.090518 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.090611 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.090831 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.090962 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.091142 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.091242 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.091453 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.091546 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.091761 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.091855 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.092074 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.092164 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.092409 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.092521 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.092731 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.092820 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.093051 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.093170 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.093374 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.093574 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.093687 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.093892 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.093998 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.094230 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.094319 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.094560 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.094801 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.094900 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.095110 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.095207 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.095442 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.095533 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.095764 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.095864 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.096087 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.096177 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.096430 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.096523 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.096746 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.096845 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.097059 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.097148 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.097365 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.097455 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.097666 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.097939 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098040 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098124 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098269 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098360 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098571 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098678 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098894 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.098995 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.099199 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.099421 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.099520 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.099775 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.099865 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.100094 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.100183 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.100458 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.100648 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.100789 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.100994 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.101109 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.101307 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.101420 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.101632 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.101747 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.101957 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.102048 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.102271 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.102368 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.102574 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.102664 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.102894 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.102984 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.103200 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.103308 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.103502 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.103599 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.104385 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.104479 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.104701 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.104801 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.105007 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.105105 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.105311 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.105403 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.105616 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.105776 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.105921 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.106010 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.106222 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.106319 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.106531 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.106622 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.106837 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.106973 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.107146 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.107258 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.107466 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.107724 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.107827 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.108039 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.108134 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.108376 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.108488 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.108680 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.108805 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.109000 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.109312 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.109543 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.109669 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.109925 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.110241 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.110373 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.110549 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.110861 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.111125 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.111231 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.111452 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.111548 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.112164 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.112249 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.112347 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.112424 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.112491 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.112558 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113106 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113204 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113274 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113351 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113420 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113500 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113649 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.113722 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.114117 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.114207 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.114290 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.114369 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.114609 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.114870 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.114977 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.115182 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.115288 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.115559 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.115654 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.115830 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.115916 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.116121 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.116214 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.116478 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.116570 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.116790 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.116893 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.117099 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.117348 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.117450 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.117681 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.117774 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.118000 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.118092 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.118319 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.118423 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.118636 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.118729 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.118945 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.119036 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.119286 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.119379 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.119629 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.119714 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.119903 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.119995 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.120214 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.120328 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.120553 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.120644 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.120862 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.120965 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.121168 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.121259 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.121476 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.121570 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.121785 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.121887 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.122093 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.122260 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.122405 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.122549 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.122693 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.122849 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.122995 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.123156 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.123382 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.123540 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.123686 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.123838 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.123991 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.124144 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.124316 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.124469 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.124626 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.124772 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.124922 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.125068 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.125225 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.125369 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.125546 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.125705 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.125851 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.125994 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.126146 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.126297 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.126450 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.126594 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.126738 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.126881 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.127026 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.127189 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.127335 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.127489 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.127636 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.127785 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.127938 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.128092 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.128238 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.128420 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.128567 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.128726 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.128871 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.129034 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.129180 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.129332 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.129476 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.129627 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.129779 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.129936 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.130081 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.130232 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.130382 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.130527 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.130680 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.130835 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.130980 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.131123 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.131266 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.131457 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.131623 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.131770 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.131913 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.132056 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.132200 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.132375 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.132534 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.132691 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.132847 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.132992 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.133136 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.133292 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.133467 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.133623 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.133767 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.133911 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.134054 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.134211 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.134356 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.134500 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.134651 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.134817 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.135469 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.135633 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.135780 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.135936 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.136081 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.136224 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.136413 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.136562 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.136706 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.136850 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.137005 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.137160 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.137313 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.137458 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.137602 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.137744 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.137888 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.138031 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.138189 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.138334 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.138478 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.138622 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.138766 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.138909 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.139120 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.139282 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.139428 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.139582 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.139734 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.139888 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.140039 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.140184 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.140346 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.140497 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.140651 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.140811 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.140964 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.141130 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.141275 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.141419 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.141568 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.141731 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.141885 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.142030 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.142174 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.142331 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.142481 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.142703 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.142852 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.143002 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.143161 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.143312 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.143474 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.143619 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.143770 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.143915 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.144059 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.144202 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.144380 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.144530 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.144675 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.144826 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.144982 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.145133 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.145291 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.145291 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.145576 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.145723 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.145873 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.146027 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.146185 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.146329 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.146473 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.146625 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.146791 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.146946 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.147093 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.147244 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.147389 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.147541 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.147693 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.147847 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.147992 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.148143 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.148363 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.148517 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.148674 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.148838 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.148983 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.149128 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.149272 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.149415 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.149569 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.149714 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.149865 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.150009 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.150153 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.150297 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.150450 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.151172 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.151322 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.151466 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.151630 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.151783 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.151938 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.152084 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.152228 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.152401 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.152547 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.152703 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.152848 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.152992 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.153154 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:38:36.153307 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.153453 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.153663 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.153975 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.154283 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.154587 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:38:36.154829 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:38:36.175660 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_db.sqlalchemy.engines [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.176705 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_db.sqlalchemy.engines [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.238833 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.context [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1(cell1) {{(pid=108949) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:38:36.239045 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.context [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1(cell1) {{(pid=108950) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:38:36.243004 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:36.243138 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_concurrency.lockutils [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:36.244625 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:36.244764 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_concurrency.lockutils [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:36.245427 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:36.245523 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_concurrency.lockutils [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:36.247345 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:36.247464 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_concurrency.lockutils [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:36.259354 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_db.sqlalchemy.engines [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.262854 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_db.sqlalchemy.engines [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.265284 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_db.sqlalchemy.engines [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.270438 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_db.sqlalchemy.engines [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.423158 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_db.sqlalchemy.engines [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.425880 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG oslo_db.sqlalchemy.engines [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:38:36.764213 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: WARNING keystonemiddleware.auth_token [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:38:36.764424 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: WARNING keystonemiddleware.auth_token [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:38:36.770825 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: WARNING keystonemiddleware.auth_token [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:38:36.770940 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: WARNING keystonemiddleware.auth_token [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:38:37.113836 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: WARNING keystonemiddleware.auth_token [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:38:37.114653 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: WARNING keystonemiddleware.auth_token [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:38:37.119221 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: WARNING keystonemiddleware.auth_token [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:38:37.120576 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: WARNING keystonemiddleware.auth_token [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:38:37.124916 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5575400019c0 pid: 108950 (default app) Mar 08 19:38:37.125682 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5575400019c0 pid: 108949 (default app) Mar 08 19:38:37.127017 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:37.128210 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-97bbe721-9da1-400f-bc97-3a82c684a761 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Mar 08 19:38:37.128651 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Tue Mar 8 19:38:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:39:59.726425 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:39:59.728583 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003304 Mar 08 19:39:59.729018 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:00.168940 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-0872c5f5-867b-4ea1-aa25-e64c34f93385 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:00.201159 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-0872c5f5-867b-4ea1-aa25-e64c34f93385 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462976 Mar 08 19:40:00.201896 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Mar 8 19:39:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:40:02.591340 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:02.592538 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-17d5d02a-5f6e-4654-93eb-a5e8fa6ed868 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Mar 08 19:40:02.598187 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 2/4] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:02.655169 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-57b3ad64-cc8a-48a1-bfc4-602249653c20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "disk": 1}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:02.674064 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:40:02.674064 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: warnings.warn(msg) Mar 08 19:40:02.701752 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-57b3ad64-cc8a-48a1-bfc4-602249653c20 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102165 Mar 08 19:40:02.702240 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 3/5] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:40:02.918421 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-37129a13-27c7-466d-a691-f605137dfe9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:02.920841 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:40:02.920841 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: warnings.warn(msg) Mar 08 19:40:02.971706 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-37129a13-27c7-466d-a691-f605137dfe9b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261390 Mar 08 19:40:02.982893 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 3/6] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Mar 8 19:40:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:05.334812 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-57b3ad64-cc8a-48a1-bfc4-602249653c20 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:05.335957 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-57b3ad64-cc8a-48a1-bfc4-602249653c20 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Mar 08 19:40:05.336306 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 4/7] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:05.452413 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-b1074463-1b68-464d-9ad8-1610dfa7fb54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d1", "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:05.470167 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:40:05.470167 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: warnings.warn(msg) Mar 08 19:40:05.491271 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-b1074463-1b68-464d-9ad8-1610dfa7fb54 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148684 Mar 08 19:40:05.491842 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 4/8] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:40:05.504422 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-98e82a26-2b9c-44e4-ab19-ec498d85cb82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:05.506021 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:40:05.506021 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: warnings.warn(msg) Mar 08 19:40:05.540179 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-98e82a26-2b9c-44e4-ab19-ec498d85cb82 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039398 Mar 08 19:40:05.541045 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 5/9] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Mar 8 19:40:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:07.938466 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-b1074463-1b68-464d-9ad8-1610dfa7fb54 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:07.939496 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-b1074463-1b68-464d-9ad8-1610dfa7fb54 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Mar 08 19:40:07.939900 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:07.999312 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-a4ef59d4-32fa-46c6-8d48-407318a7cf02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "swap": 0}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:08.020588 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-a4ef59d4-32fa-46c6-8d48-407318a7cf02 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074731 Mar 08 19:40:08.022145 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 6/11] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:40:08.033889 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-5be7e1c5-3e4c-4606-809d-39985fcaac5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:08.057899 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-5be7e1c5-3e4c-4606-809d-39985fcaac5c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027773 Mar 08 19:40:08.068597 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 6/12] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Mar 8 19:40:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:40:10.432996 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-a4ef59d4-32fa-46c6-8d48-407318a7cf02 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:10.434021 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-a4ef59d4-32fa-46c6-8d48-407318a7cf02 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Mar 08 19:40:10.434431 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 7/13] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:10.497519 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-59344ffc-e572-4934-821f-4f1ce96b7966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:10.514927 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-59344ffc-e572-4934-821f-4f1ce96b7966 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074113 Mar 08 19:40:10.515585 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 7/14] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:40:10.527755 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-2c73ed52-4d82-4a0f-9f3c-75070bb5b8e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:10.551152 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-2c73ed52-4d82-4a0f-9f3c-75070bb5b8e1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027636 Mar 08 19:40:10.551933 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 8/15] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Mar 8 19:40:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:12.965754 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-59344ffc-e572-4934-821f-4f1ce96b7966 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:12.966961 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-59344ffc-e572-4934-821f-4f1ce96b7966 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Mar 08 19:40:12.967715 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 8/16] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:13.030393 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-f6641e1c-c07e-4239-bac5-3f13876b3c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "name": "ds4G"}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:13.049319 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-f6641e1c-c07e-4239-bac5-3f13876b3c17 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075705 Mar 08 19:40:13.057200 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 9/17] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:40:13.062195 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-24ce9205-c84c-44e1-9686-21f9cb5027e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:13.084153 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-24ce9205-c84c-44e1-9686-21f9cb5027e9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025684 Mar 08 19:40:13.094384 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 9/18] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Mar 8 19:40:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:15.565464 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-f6641e1c-c07e-4239-bac5-3f13876b3c17 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:15.566494 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-f6641e1c-c07e-4239-bac5-3f13876b3c17 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Mar 08 19:40:15.566886 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 10/19] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:15.627061 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-f06e28b0-fa3c-47d2-9060-a15e7d842e77 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:15.652190 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-f06e28b0-fa3c-47d2-9060-a15e7d842e77 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078442 Mar 08 19:40:15.652920 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 10/20] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Mar 8 19:40:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:40:18.425090 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-f6641e1c-c07e-4239-bac5-3f13876b3c17 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:18.426411 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-f6641e1c-c07e-4239-bac5-3f13876b3c17 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001858 Mar 08 19:40:18.426951 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 11/21] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:18.493215 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-de257b8d-1f5b-4fad-988a-f34fff483a7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:18.511972 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-de257b8d-1f5b-4fad-988a-f34fff483a7f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078918 Mar 08 19:40:18.512573 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 11/22] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:40:18.524277 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-81c03a8d-6b1c-40c7-9b82-10f7a35dfedc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:18.547416 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-81c03a8d-6b1c-40c7-9b82-10f7a35dfedc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026773 Mar 08 19:40:18.547998 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 12/23] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Mar 8 19:40:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:20.913065 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-de257b8d-1f5b-4fad-988a-f34fff483a7f admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:20.914739 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-de257b8d-1f5b-4fad-988a-f34fff483a7f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Mar 08 19:40:20.915151 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:20.974346 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-e6a69752-f468-4614-96fd-113cf6d182f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:20.995301 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-e6a69752-f468-4614-96fd-113cf6d182f8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073977 Mar 08 19:40:20.996011 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 13/25] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:40:21.009769 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-dc885077-2076-4945-b619-800fa2477a56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:21.035178 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-dc885077-2076-4945-b619-800fa2477a56 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028973 Mar 08 19:40:21.035781 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 13/26] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Mar 8 19:40:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:23.446306 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-e6a69752-f468-4614-96fd-113cf6d182f8 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:23.447315 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-e6a69752-f468-4614-96fd-113cf6d182f8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Mar 08 19:40:23.447727 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:23.506309 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-fff03195-c23e-4eee-992d-02132064550d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3"}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:23.523468 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-fff03195-c23e-4eee-992d-02132064550d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069804 Mar 08 19:40:23.524013 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 14/28] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:40:23.535564 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-828e3183-ad3b-4394-abaf-acd63eb679ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:23.558350 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-828e3183-ad3b-4394-abaf-acd63eb679ea admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026412 Mar 08 19:40:23.558924 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 15/29] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Mar 8 19:40:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:25.913617 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-fff03195-c23e-4eee-992d-02132064550d admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:25.915193 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-fff03195-c23e-4eee-992d-02132064550d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Mar 08 19:40:25.915663 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:25.984238 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-6febc970-351c-4c98-b1a7-b22dbe7e3c22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "name": "m1.large", "swap": 0}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:26.003921 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-6febc970-351c-4c98-b1a7-b22dbe7e3c22 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082453 Mar 08 19:40:26.004802 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 16/31] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:40:26.022980 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-6b36b92a-1e6a-4ccd-99c6-d4ccf4896c81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:26.047029 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-6b36b92a-1e6a-4ccd-99c6-d4ccf4896c81 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029968 Mar 08 19:40:26.048322 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 16/32] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Mar 8 19:40:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:28.472683 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-6febc970-351c-4c98-b1a7-b22dbe7e3c22 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:28.473702 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-6febc970-351c-4c98-b1a7-b22dbe7e3c22 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Mar 08 19:40:28.474104 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 17/33] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:28.543804 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-e335baef-32ec-472a-86ae-c59a8d9f79bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "id": "5"}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:28.563110 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-e335baef-32ec-472a-86ae-c59a8d9f79bf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082199 Mar 08 19:40:28.563668 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 17/34] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Mar 8 19:40:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:40:28.575865 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-ab77d04e-bb92-4b91-a552-4b911e617e7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:28.611998 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-ab77d04e-bb92-4b91-a552-4b911e617e7c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039710 Mar 08 19:40:28.613103 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 18/35] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Mar 8 19:40:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:40:52.031146 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-e335baef-32ec-472a-86ae-c59a8d9f79bf admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:52.032178 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-e335baef-32ec-472a-86ae-c59a8d9f79bf admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Mar 08 19:40:52.032622 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:40:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:52.089752 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-c99c14d4-c506-4550-bc98-dce5515d3c8d admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:52.107123 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-c99c14d4-c506-4550-bc98-dce5515d3c8d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068444 Mar 08 19:40:52.107666 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Mar 8 19:40:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:40:53.496340 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-e335baef-32ec-472a-86ae-c59a8d9f79bf admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:53.497351 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-e335baef-32ec-472a-86ae-c59a8d9f79bf admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Mar 08 19:40:53.497758 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 19/38] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:53.715141 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-0fef9048-6f10-4a77-9697-2e3f8d6a52fa admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:53.720861 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.wsgi [None req-0fef9048-6f10-4a77-9697-2e3f8d6a52fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 19:40:53.721441 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-0fef9048-6f10-4a77-9697-2e3f8d6a52fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:40:53.722249 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-0fef9048-6f10-4a77-9697-2e3f8d6a52fa admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060889 Mar 08 19:40:53.722774 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 20/39] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Mar 8 19:40:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:40:53.734051 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-8309d1e1-607f-47d2-88a9-66e95b7b567a admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:53.754932 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-8309d1e1-607f-47d2-88a9-66e95b7b567a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025803 Mar 08 19:40:53.755483 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Mar 8 19:40:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:40:53.765299 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-d735bed3-cfcf-49c5-b1e0-82d4a9bd5df0 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:53.786667 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-d735bed3-cfcf-49c5-b1e0-82d4a9bd5df0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024941 Mar 08 19:40:53.787216 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 21/41] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Mar 8 19:40:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:40:53.797279 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-d168afe2-a53a-4951-b424-88a0fd665658 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:53.802585 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.wsgi [None req-d168afe2-a53a-4951-b424-88a0fd665658 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 19:40:53.803142 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-d168afe2-a53a-4951-b424-88a0fd665658 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:40:53.803919 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-d168afe2-a53a-4951-b424-88a0fd665658 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010469 Mar 08 19:40:53.804435 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Mar 8 19:40:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:40:55.062836 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-d735bed3-cfcf-49c5-b1e0-82d4a9bd5df0 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:55.063843 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-d735bed3-cfcf-49c5-b1e0-82d4a9bd5df0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Mar 08 19:40:55.064240 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 22/43] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:40:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:55.252342 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-f4de626a-57f6-441d-947f-4721fbd8a6f4 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:55.258321 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.wsgi [None req-f4de626a-57f6-441d-947f-4721fbd8a6f4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 19:40:55.258975 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-f4de626a-57f6-441d-947f-4721fbd8a6f4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:40:55.259779 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-f4de626a-57f6-441d-947f-4721fbd8a6f4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059360 Mar 08 19:40:55.260345 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Mar 8 19:40:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:40:55.269653 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-d58de047-33c2-4a46-b713-7db02c25bd72 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:55.283155 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-d58de047-33c2-4a46-b713-7db02c25bd72 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016994 Mar 08 19:40:55.283629 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Mar 8 19:40:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:40:55.293091 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-600dc326-bff3-42da-a13d-044523cf1a3a admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:55.307403 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-600dc326-bff3-42da-a13d-044523cf1a3a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017931 Mar 08 19:40:55.307930 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Mar 8 19:40:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:40:55.317122 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-116ce22e-b80d-4272-95f1-b71c97824688 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:55.323122 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.wsgi [None req-116ce22e-b80d-4272-95f1-b71c97824688 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 19:40:55.323688 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-116ce22e-b80d-4272-95f1-b71c97824688 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:40:55.324510 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-116ce22e-b80d-4272-95f1-b71c97824688 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010933 Mar 08 19:40:55.325020 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Mar 8 19:40:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:40:56.603877 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-600dc326-bff3-42da-a13d-044523cf1a3a admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:56.604910 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-600dc326-bff3-42da-a13d-044523cf1a3a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Mar 08 19:40:56.605313 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 24/48] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:56.792646 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-fc6acce6-610e-4af2-aa1c-d23153be1bff admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:56.798752 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.wsgi [None req-fc6acce6-610e-4af2-aa1c-d23153be1bff admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 19:40:56.799310 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-fc6acce6-610e-4af2-aa1c-d23153be1bff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:40:56.800098 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-fc6acce6-610e-4af2-aa1c-d23153be1bff admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058000 Mar 08 19:40:56.800777 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 25/49] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Mar 8 19:40:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:40:56.810108 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-45b64dac-7a81-4ab1-b7fe-db675a1430a0 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:56.823339 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-45b64dac-7a81-4ab1-b7fe-db675a1430a0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016727 Mar 08 19:40:56.823862 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Mar 8 19:40:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:40:56.834887 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:56.848327 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018635 Mar 08 19:40:56.848855 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 26/51] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Mar 8 19:40:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:40:56.858788 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-c709de7d-0dac-4f58-aada-539752efe865 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:56.863874 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.wsgi [None req-c709de7d-0dac-4f58-aada-539752efe865 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 19:40:56.864477 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-c709de7d-0dac-4f58-aada-539752efe865 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:40:56.865282 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-c709de7d-0dac-4f58-aada-539752efe865 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010055 Mar 08 19:40:56.865775 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Mar 8 19:40:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:40:58.138019 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:58.139032 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Mar 08 19:40:58.139429 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:58.327798 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-777a1283-8508-4881-8b6b-363833d2b0d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:58.347357 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-777a1283-8508-4881-8b6b-363833d2b0d6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071357 Mar 08 19:40:58.347825 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 27/54] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Mar 8 19:40:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:40:59.616305 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:40:59.617314 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Mar 08 19:40:59.617712 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 28/55] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:40:59.807342 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-015b0d46-9a61-4b05-b368-e2fbdb1fc709 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:40:59.824513 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-015b0d46-9a61-4b05-b368-e2fbdb1fc709 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069036 Mar 08 19:40:59.825060 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 28/56] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Mar 8 19:40:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:41:01.129417 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:01.130427 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Mar 08 19:41:01.130824 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 29/57] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:41:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:41:01.318282 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-ef308848-4e4b-438d-bdb3-4054689bf7ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:41:01.335780 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-ef308848-4e4b-438d-bdb3-4054689bf7ca admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069324 Mar 08 19:41:01.336411 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 29/58] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Mar 8 19:41:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:41:02.625347 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:02.626356 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Mar 08 19:41:02.626761 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 30/59] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:41:02.820733 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-1f99c04c-bc2a-4cd2-b835-ff6dbc650d95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:41:02.839125 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-1f99c04c-bc2a-4cd2-b835-ff6dbc650d95 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069705 Mar 08 19:41:02.839596 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 30/60] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Mar 8 19:41:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:41:04.140712 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:04.141700 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Mar 08 19:41:04.142088 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 31/61] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:41:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:41:04.333012 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-01d43e4e-d6e6-4169-9b50-f1b02c92d51d admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:04.352354 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-01d43e4e-d6e6-4169-9b50-f1b02c92d51d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071144 Mar 08 19:41:04.352820 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 31/62] 10.222.0.45 () {60 vars in 1202 bytes} [Tue Mar 8 19:41:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:41:55.408875 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:55.409865 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-952a2d5e-8e2a-4d49-b49c-3fcfb64a47a3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Mar 08 19:41:55.410255 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 32/63] 10.222.0.45 () {54 vars in 930 bytes} [Tue Mar 8 19:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:41:55.467472 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-06f70285-b237-4158-a734-124fb7519ad9 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:55.486737 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-06f70285-b237-4158-a734-124fb7519ad9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070093 Mar 08 19:41:55.487269 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 32/64] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Mar 8 19:41:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:41:55.508560 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-3b06c9d4-84cb-4764-a298-fe1e31735002 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:55.516017 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-3b06c9d4-84cb-4764-a298-fe1e31735002 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011016 Mar 08 19:41:55.516566 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 33/65] 10.222.0.45 () {60 vars in 1282 bytes} [Tue Mar 8 19:41:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:41:55.528089 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-b3d642cc-d101-43b6-97dc-4229b015eec5 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:55.535515 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-b3d642cc-d101-43b6-97dc-4229b015eec5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010973 Mar 08 19:41:55.536035 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 33/66] 10.222.0.45 () {60 vars in 1285 bytes} [Tue Mar 8 19:41:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:41:55.548051 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-7e7432c0-3efd-4f89-aca0-e2d430e2db82 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:55.555440 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-7e7432c0-3efd-4f89-aca0-e2d430e2db82 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011129 Mar 08 19:41:55.555970 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 34/67] 10.222.0.45 () {60 vars in 1285 bytes} [Tue Mar 8 19:41:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:41:55.566914 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:41:55.574435 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011101 Mar 08 19:41:55.574954 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 34/68] 10.222.0.45 () {60 vars in 1282 bytes} [Tue Mar 8 19:41:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:43:27.327033 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-92114520-3c0d-4204-a4f1-220eb4d76616 tempest-verify_tempest_config-1636634992 tempest-verify_tempest_config-1636634992-project] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:43:27.329013 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-92114520-3c0d-4204-a4f1-220eb4d76616 tempest-verify_tempest_config-1636634992 tempest-verify_tempest_config-1636634992-project] 10.222.0.45 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105683 Mar 08 19:43:27.329540 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 35/69] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Mar 8 19:43:27 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:45:07.738532 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:07.739531 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Mar 08 19:45:07.739928 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 35/70] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:45:08.004823 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-67a0c6c4-9963-4e83-be34-4e071a7be4a8 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:08.005995 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:45:08.005995 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: warnings.warn(msg) Mar 08 19:45:08.008479 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-67a0c6c4-9963-4e83-be34-4e071a7be4a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:08.009414 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-67a0c6c4-9963-4e83-be34-4e071a7be4a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:08.012125 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-67a0c6c4-9963-4e83-be34-4e071a7be4a8 admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:08.013752 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-67a0c6c4-9963-4e83-be34-4e071a7be4a8 admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:08.051968 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-67a0c6c4-9963-4e83-be34-4e071a7be4a8 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.164322 Mar 08 19:45:08.052523 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 36/71] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Mar 8 19:45:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:45:09.336526 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:09.337530 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Mar 08 19:45:09.337930 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 36/72] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:45:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:45:09.537539 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-9e38ca83-b9cb-40e7-8cd8-a5a4e0123541 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:09.538721 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:45:09.538721 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: warnings.warn(msg) Mar 08 19:45:09.540561 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-9e38ca83-b9cb-40e7-8cd8-a5a4e0123541 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:09.541030 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-9e38ca83-b9cb-40e7-8cd8-a5a4e0123541 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:09.541810 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-9e38ca83-b9cb-40e7-8cd8-a5a4e0123541 admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:09.542235 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-9e38ca83-b9cb-40e7-8cd8-a5a4e0123541 admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:09.561237 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-9e38ca83-b9cb-40e7-8cd8-a5a4e0123541 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074114 Mar 08 19:45:09.561781 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 37/73] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Mar 8 19:45:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:45:21.247273 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:21.248271 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Mar 08 19:45:21.248696 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 37/74] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:45:21.440140 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-2ac22c33-606e-409c-8ec4-0c8cbf562f7a admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:21.441317 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:45:21.441317 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: warnings.warn(msg) Mar 08 19:45:21.442494 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-2ac22c33-606e-409c-8ec4-0c8cbf562f7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:21.442933 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-2ac22c33-606e-409c-8ec4-0c8cbf562f7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:21.443717 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-2ac22c33-606e-409c-8ec4-0c8cbf562f7a admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:21.444170 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-2ac22c33-606e-409c-8ec4-0c8cbf562f7a admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:21.468486 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-2ac22c33-606e-409c-8ec4-0c8cbf562f7a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081326 Mar 08 19:45:21.469045 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 38/75] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Mar 8 19:45:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:45:22.746262 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: DEBUG nova.api.openstack.wsgi [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] Calling method '>' {{(pid=108949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:22.747265 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: INFO nova.api.openstack.requestlog [None req-9f887abc-ddcb-4b16-9b98-2adc4a614583 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Mar 08 19:45:22.747665 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: [pid: 108949|app: 0|req: 38/76] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Mar 8 19:45:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:45:22.945324 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG nova.api.openstack.wsgi [None req-338eb1fb-4125-47fc-a3e4-dea50a12c125 admin admin] Calling method '>' {{(pid=108950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:45:22.946473 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:45:22.946473 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: warnings.warn(msg) Mar 08 19:45:22.947675 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-338eb1fb-4125-47fc-a3e4-dea50a12c125 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:22.948110 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-338eb1fb-4125-47fc-a3e4-dea50a12c125 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:22.948926 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-338eb1fb-4125-47fc-a3e4-dea50a12c125 admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:45:22.949351 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: DEBUG oslo_concurrency.lockutils [None req-338eb1fb-4125-47fc-a3e4-dea50a12c125 admin admin] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:45:22.970231 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: INFO nova.api.openstack.requestlog [None req-338eb1fb-4125-47fc-a3e4-dea50a12c125 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076057 Mar 08 19:45:22.970703 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: [pid: 108950|app: 0|req: 39/77] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Mar 8 19:45:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:46:22.263271 dv-cinder-830093-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 08 19:46:22.264361 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: Tue Mar 8 19:46:22 2022 - graceful shutdown triggered... Mar 08 19:46:22.264882 dv-cinder-830093-3-iscsi devstack@n-api.service[108949]: Gracefully killing worker 1 (pid: 108949)... Mar 08 19:46:22.265257 dv-cinder-830093-3-iscsi devstack@n-api.service[108950]: Gracefully killing worker 2 (pid: 108950)... Mar 08 19:46:23.265486 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: worker 1 buried after 1 seconds Mar 08 19:46:23.265918 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: worker 2 buried after 1 seconds Mar 08 19:46:23.265918 dv-cinder-830093-3-iscsi devstack@n-api.service[108948]: goodbye to uWSGI. Mar 08 19:46:23.266979 dv-cinder-830093-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 08 19:46:23.267547 dv-cinder-830093-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 08 19:46:23.270246 dv-cinder-830093-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 19:46:23.285047 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 19:46:23 2022] *** Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: nodename: dv-cinder-830093-3-iscsi Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: machine: x86_64 Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: clock source: unix Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: pcre jit disabled Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: detected number of CPU cores: 4 Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: current working directory: / Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: detected binary path: /usr/bin/uwsgi-core Mar 08 19:46:23.307906 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: your processes number limit is 47680 Mar 08 19:46:23.308772 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: your memory page size is 4096 bytes Mar 08 19:46:23.308772 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: detected max file descriptor number: 2048 Mar 08 19:46:23.308772 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: lock engine: pthread robust mutexes Mar 08 19:46:23.308772 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: thunder lock: enabled Mar 08 19:46:23.308772 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 19:46:23.308772 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 19:46:23.355113 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: Python main interpreter initialized at 0x5617ce3ef9c0 Mar 08 19:46:23.355113 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: python threads support enabled Mar 08 19:46:23.355113 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: your server socket listen backlog is limited to 100 connections Mar 08 19:46:23.355113 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: your mercy for graceful operations on workers is 90 seconds Mar 08 19:46:23.355555 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 19:46:23.355555 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: *** Operational MODE: preforking *** Mar 08 19:46:23.355871 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: *** uWSGI is running in multiple interpreter mode *** Mar 08 19:46:23.355871 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: spawned uWSGI master process (pid: 123363) Mar 08 19:46:23.356079 dv-cinder-830093-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 19:46:23.368982 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: spawned uWSGI worker 1 (pid: 123380, cores: 1) Mar 08 19:46:23.368982 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: spawned uWSGI worker 2 (pid: 123381, cores: 1) Mar 08 19:46:23.368982 dv-cinder-830093-3-iscsi devstack@n-api.service[123363]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 19:46:25.278103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:46:25.278103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: from cryptography.utils import int_from_bytes Mar 08 19:46:25.278787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:46:25.278787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: from cryptography.utils import int_from_bytes Mar 08 19:46:25.301740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:46:25.301740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: from cryptography.utils import int_from_bytes Mar 08 19:46:25.302376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:46:25.302376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: from cryptography.utils import int_from_bytes Mar 08 19:46:27.657201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:46:27.657748 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:46:27.658047 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:46:27.658394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:46:27.658657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:46:27.659055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.659385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.659709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.660029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.660425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.660744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.661077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.661398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.661725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.661989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.662307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.662636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830093-3-iscsi {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.662962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.663274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.663587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.663915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.664215 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.664562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.664872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.665930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.667543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.667543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.667543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.667910 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.668193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.668540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.668867 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.669183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.669511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.669825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.670247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830093-3-iscsi {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.670560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.670892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.671209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.671630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.671956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.672269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.672675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.673004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.673322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.673652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.673977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.674304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.674628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.674936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.675250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.675563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.675889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.676196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.676536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.676791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.677103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.677432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.677757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.678086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.678344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.678598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.678921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.679245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.679561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.679869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.680178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.680545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.680857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.681167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.681476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.681792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.682116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.682435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.682764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.683073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.683395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.683802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.684056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.684392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.684740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.685064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.685375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.685699 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.686029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.686344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.686658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.686967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.687291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.687630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.687937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.688190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.688522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.688832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.689156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.689478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.689781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.690082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.690386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.690696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.691008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.691314 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.691622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.691952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.692233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.692571 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.692881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.693188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.693510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.693906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.694141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.694449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.694758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.695068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.695392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.695702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.696048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.696898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.697206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.697514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.699604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.699604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.699604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.700049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:46:27.701027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.701204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:46:27.701350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.701350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.701751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:46:27.701906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.702737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:46:27.703034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.703206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:46:27.703359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.703359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.703673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.703828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.703997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.704247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.704247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.704247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.704247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.704878 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.705726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.706154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.706379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.706539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.706687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.706869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.707037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.707295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.707450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.707450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.707450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.707450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.707450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.708142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.708317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.708467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.708609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.708750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.708889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.709040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830093-3-iscsi {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.709205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.709358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.709500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.709651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.709792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.709937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.710090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.710237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.710377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.710517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.710779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.711105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.711413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.711576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.712722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.712722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.713241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.713421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.713636 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.713978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.714142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.714406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.714760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.715016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.715192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.715392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.715541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.715541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.715832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.716022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.716169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.716949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.717072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.717250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.717404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830093-3-iscsi {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.717646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.717974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.717974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.718325 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.718491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.718491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.718491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.719065 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.719293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.719503 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.719691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.719792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.719906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.720003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.720103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.720273 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.720614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.720847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.721022 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.721374 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.721547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.721692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.721968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.722126 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.722270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.722270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.722563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.722731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.722998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.723165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.723499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.723659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.723821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.723963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.724104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.724244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.724558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.724730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.724873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.725054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.725200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.725352 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.725535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.725535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.725825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.725983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.726134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.726134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.726402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.726556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.726710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.726858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.727005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.727005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.727357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.727652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.727803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.727955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.728107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.728261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.728463 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.728715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.728863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.729005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.729155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.729344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.729498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.729676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.729830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.729988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.730138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.730279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.730425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.730573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.730714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.730861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.731088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.731467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.731619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.731769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.731918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.732145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.732339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.732499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.732649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.732799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.732959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.733179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.733353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.733645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.733825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.733972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.734112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.734265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.734415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.734593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.734834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.734990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.735140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.735292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.735485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.735633 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.735786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.735937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.736092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.736241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.736455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.736599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.736767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.736916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.737065 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.737206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.737356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.737504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.737645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.737792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.737981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.738122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.738270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.738412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.738562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.738729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.738977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.739141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.739293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.739435 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.739615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.739768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.739918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.740069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.740211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.740384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.740529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.740688 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.740829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.740984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.740984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.741267 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.741555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.741703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.741851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.742038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.742266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.742421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.742563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.742712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.742868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.743039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.743205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.743419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.743729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.743877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.744028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.744179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.744360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.744515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.744657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.744797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.745083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.745238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.745387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.745542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.745684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.745831 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.746041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.746189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.746338 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.746493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.746642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.746791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.746981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.747167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.747326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.747477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.747618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.747790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.747943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.748126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.748279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.748462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.748605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.748751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.748892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.749191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.749362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.749506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.749647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.749786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.749933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.750074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.750227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.750376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.750519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.750659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.750799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.750939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.751088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.751239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.751379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.751675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.751824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.751965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.752120 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.752280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.752554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.752695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.752835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.752986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.753142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.753291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.753473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.753845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.753998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.754184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.754335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:46:27.754477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.754620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.754761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.754909 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.755168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.755325 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.755467 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.755609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.755761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.755942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.756099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.756241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.756416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.756560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.756714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.756869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.757011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.757159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.757308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.757449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.757609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.757762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.757904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.758045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.758261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.758427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.758581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.759414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.759577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.759730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.759874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.759874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.760141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.760338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.760487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.760639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.760779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.760920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.761073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.761222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.761363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.761511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.761805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.761963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.762155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.762303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.762481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.762688 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.762841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.762985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.763136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.763277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.763425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.763566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.763730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.764200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.764377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.764526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.764679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.764827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.764976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.765147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.765379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.765525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.765666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.765806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.765947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.766096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.766247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.766389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.766535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.766770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.766922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.767947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.768232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.768421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.768565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.768726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.768870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.769018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.769166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.769307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.769571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.769729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.769872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.770011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.770151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.770328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.770469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.770619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.770779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.770946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.771212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.771375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.771527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.771682 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.771967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.771967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.772387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.772544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.772712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.773821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.774216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.774994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.775153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.775303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.775560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.775719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.775868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.776010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.776160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.776328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.776477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.776631 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.776791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.776940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.777095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.777244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.777394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.777544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.777693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.777842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.777994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.778142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.778321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.778480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.778629 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.778783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.778924 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.779145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.779297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.779451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.779612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.779866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.780014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.780155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.780363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.780511 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.780659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.780810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.780963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.781104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.781264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.781414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.781555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.781695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.781837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.782141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.782510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.782661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.782803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.782962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.783179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.783336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.783492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.783643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.783792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.783934 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.784075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.784541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.784693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.784836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.785288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.785449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.785616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.785883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786229 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.786954 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.787979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.788994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.789935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790475 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.790988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791071 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791688 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.791928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.792019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.792143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.792229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.792692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.792808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.792895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.792986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.793982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.794067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.794151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.794232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.794617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.794726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.794801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.794988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.795896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796202 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.796961 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797621 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.797940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.798032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.798255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.798346 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.798583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.798681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.798900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.798991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.799216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.799307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.799538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.799657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.799855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.799979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.800169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.800317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.800508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.800614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.800816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.800920 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.801130 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.801231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.801442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.801538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.801753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.801926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.802070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.802209 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.802356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.802502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.802683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.802836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.802985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.803123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.803268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.803424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.803582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.803747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.803890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.804037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.804210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.804408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.804545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.804784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.804888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.804972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.805153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.805252 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.805462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.805569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.805800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.805887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.806108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.806205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.806417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.806510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.806728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.806834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.807039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.807136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.807357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.807449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.807671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.807759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.807982 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.808080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.808318 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.808423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.808630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.808729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.808937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.809040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.809254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.809352 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.809567 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.809657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.809877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.809982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.810191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.810283 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.810501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.810610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.810814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.810926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.811122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.811214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.811435 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.811570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.811753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.811890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.812079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.812209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.812420 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.812559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.812733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.812878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.813041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.813195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.813353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.813519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.813654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.813840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.814002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.814159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.814558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.814898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.815351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.815675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.815996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.816441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.816737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.816840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.816970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.817052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.817289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.817411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.817627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.817769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.817939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.818136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.818249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.818492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.818573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.818877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.819064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.819186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.819399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.819513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.819732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.819925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.820249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.820395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.820585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.820689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.821011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.821703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.821868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.822043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.822185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.822391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.822515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.822846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.822955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.823175 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.823290 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.823488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.823584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.823806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.823966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.824133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.824334 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.824460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.824876 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.824991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.825112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.825238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.825432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.825743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.825891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.826072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.826208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.826401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.826583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.826724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.826934 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.827072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.827262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.827430 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.827585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.827756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.827897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.828078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.828234 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.828434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.828579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.828766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.828908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.829077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.829233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.829372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.829573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.829721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.829930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.830079 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.830250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.830397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.830555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.830692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.830882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.831017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.831197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.831333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.831511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.831648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.831822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.832032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.832197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.832434 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.832580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.832746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.832897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.833063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.833199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.833377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.833522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.833695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.833836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.834016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.834155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.834342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.834480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.834653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.834802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.834982 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.835125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.835344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.835470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.835563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.835702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.835868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.836129 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.836240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.836399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.836532 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.836716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.837413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.837584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.837719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.837906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.838059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.838221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.838393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.838542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.838706 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.838856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.839045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.839182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.839375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.839498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.839692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.839810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.840028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.840138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.840364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.840530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.840672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.840852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.840980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.841294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.841384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.841603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.841694 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.841911 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.842017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.842217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.842315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.842530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.842621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.842837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.842948 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.843141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.843229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.843448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.843539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.843773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.843865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.844080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.844178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.844429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.844746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.844914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.845052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.845197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.845357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.845463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.845667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.845797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.846016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.846137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.846322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.846413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.846639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.846743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.846953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.847049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.847267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.847358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.847676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.847780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.847914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.848015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.848240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.848588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.848910 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.849016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.849230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.849332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.849545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.849627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.849861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.849957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.850179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.850268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.850496 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.850577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.850805 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.850897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.851874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.851989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.852092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.852179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.852263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.852398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.852398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.852640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.852967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.853397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.853753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.854093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.854217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.854485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.854607 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.854754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.854890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.855086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.855284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.855417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.855614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.855750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.855944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.856064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.856265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.856391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.856600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.856700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.856937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.857029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.857263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.857369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.857585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.857689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.857918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.858018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.858252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.858351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.858603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.858926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.859024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.859249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.859351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.859575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.859672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.859901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.860000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.860221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.860362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.860571 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.860671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.860892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.860989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.861210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.861303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.861528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.861673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.861846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.862006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.862167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.862332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.862486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.862654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.862805 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.862977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.863108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.863299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.863416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.863618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.863738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.863939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.864041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.864257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.864418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.864632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.864732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.864948 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.865040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.865266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.865371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.865581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.865687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.865901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.866141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.866253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.866463 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.866648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.866801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.866971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.867132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.867295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.867462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.867611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.867792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.867930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.868148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.868431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.868528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.868762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.868929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.869089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.869180 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.869404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.869502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.869719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.869823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.870029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.870128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.870360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.870460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.870678 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.870779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.870990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.871079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.871317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.871431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.871631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.871800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.872145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.872243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.872499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.872604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.872814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.872915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.873133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.873243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.873466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.873568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.873781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.873884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.874109 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.874201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.874439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.874539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.874751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.874842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.875062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.875153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.875384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.875562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.875683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.875886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.875996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.876205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.876320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.876563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.876664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.876895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.876986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.877220 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.877311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.877533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.877624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.877846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.877935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.878163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.878262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.878472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.878570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.878781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.878880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.879089 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.879190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.879408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.879499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.879718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.879817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.880028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.880359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.880671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.880795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.880986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.881150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.881293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.881520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.881603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.881901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.882049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.882214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.882487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.882584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.882821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.882916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.883144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.883239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.883481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.883580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.884567 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.884714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.884827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.884936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.885061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.885194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.885312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.885422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.885574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.885705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.885947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.886075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.886185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.886312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.886529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.886660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.886846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.886949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.887162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.887382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.887532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.887722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.887857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.888046 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.888169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.888420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.888655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.888762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.888974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.889066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.889350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.889442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.889658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.889761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.889985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.890084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.890299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.890614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.890865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.890984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.891195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.891311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.891524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.891616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.891838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.891939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.892150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.892314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.892493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.892802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.892908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.893115 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.893446 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.893535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.893742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.893972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.894067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.894508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.894707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.894809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.895028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.895136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.895349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.895442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.895672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.895785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.895992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.896153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.896333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.896441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.896648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.896759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.897072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.897272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.897482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.897609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.897824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.897932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.898163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.898269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.898563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.898665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.898935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.899284 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.899919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.900251 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.900594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.900921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.901249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.901377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.901556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.901999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.902196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.902318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.902529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.902724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.902874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.903062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.903206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.903392 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.903538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.903735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.903836 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.904026 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.904129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.904368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.904488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.904712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.904807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.905038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.905139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.905377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.905478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.905675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.905762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.905992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.906086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.906306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.906425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.906618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.906720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.906928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.907056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.907466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.907576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.907663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.907739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.907819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.907925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.908140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.908249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.908473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.908595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.908790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.908920 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.909099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.909257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.909406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.909633 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.909730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.909971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.910073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.910297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.910398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.910604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.910793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.911003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.911110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.911367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.911483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.911662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.911820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.912099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.912211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.912466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.912569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.912822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.912931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.913148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.913397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.913638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.913879 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.913984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.914229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.914347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.914572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.914670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.914955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.915060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.915301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.915411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.915646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.915749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.916037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.916143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.916415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.916536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.916737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.916837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.917062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.917167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.917822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.917979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.918295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.918402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.918638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.918742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.918973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.919062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.919271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.919411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.919588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.919925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.920100 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.920240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.920466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.920575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.920799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.920914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.921128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.921234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.921458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.921562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.921843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.921950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.922140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.922235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.922456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.922553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.922768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.922871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.923088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.923195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.923410 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.923514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.923729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.923824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.924056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.924157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.924385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.924517 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.924714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.924811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.925039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.925207 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.925364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.925460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.925691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.925794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.926015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.926114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.926339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.926447 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.926656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.926772 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.926965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.927061 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.927211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:46:27.927324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.927623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.928067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.928535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.928877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.929289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.929605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.929952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.930281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.930630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.930967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.931284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.931600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.931922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.932242 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.932581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.932917 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.933237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.934616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.934978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.935314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.935884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.936263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.936696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.937044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.937389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.937748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.938197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.938398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.938719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.939038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.939370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.939691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.940008 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.940377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.940670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.940992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.941308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.941628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.941942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.942279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.942595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.942911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.943224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.943544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.943857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.944192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.944520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.944839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.945852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.946085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.946953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.947271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.947595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.947912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.948274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.948618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.948960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.949276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.949596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.949928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.950247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.950581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.950720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_db.sqlalchemy.engines [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:27.950903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.951227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.951590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.951919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.952512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.952861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.953193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.953541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.953951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.954196 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.954515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.954832 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.955247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.955489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.955877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.956197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.957006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.957006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.957249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.957569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.958074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.958397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.958720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.959043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.959362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.959690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.960044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.960411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.960730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.961058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.968255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.968255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.968255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.968255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.968599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.968818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.969044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.969360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.969676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.970073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.970309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.970637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.970956 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.971271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.971577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.971898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.972211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.972553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.972867 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.973182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.973501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.973814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.974144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.974432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.974745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.975058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.975376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.975696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.976021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.976756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.976756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.977092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.977258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.977629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.977975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.978302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.978633 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.978953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.979284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.979639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.979970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.980255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.980615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.980931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.981272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.981593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.981913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.982233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.982635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.982866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.983187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.983525 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.983863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.984178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.984539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.984865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.985203 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.985528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.985849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.986188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.986508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.986831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.987155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.987475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.987796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.988121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.988470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.988806 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.989142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.989477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.989814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.990171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.990490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.990844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.991178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.991644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.991863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.992208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:46:27.992568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:46:28.016044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_db.sqlalchemy.engines [None req-88ec2085-4228-497c-a46b-37797563472d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:28.017333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.context [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1(cell1) {{(pid=123380) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:46:28.021639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:46:28.023210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:46:28.024033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:46:28.026583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:46:28.037289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_db.sqlalchemy.engines [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:28.041471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_db.sqlalchemy.engines [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:28.083055 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.context [None req-88ec2085-4228-497c-a46b-37797563472d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1(cell1) {{(pid=123381) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:46:28.087429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88ec2085-4228-497c-a46b-37797563472d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:46:28.089065 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88ec2085-4228-497c-a46b-37797563472d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:46:28.089904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88ec2085-4228-497c-a46b-37797563472d None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:46:28.091890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88ec2085-4228-497c-a46b-37797563472d None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:46:28.102977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_db.sqlalchemy.engines [None req-88ec2085-4228-497c-a46b-37797563472d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:28.105232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_db.sqlalchemy.engines [None req-88ec2085-4228-497c-a46b-37797563472d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:28.203398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_db.sqlalchemy.engines [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:28.276429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_db.sqlalchemy.engines [None req-88ec2085-4228-497c-a46b-37797563472d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:46:28.521301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: WARNING keystonemiddleware.auth_token [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:46:28.596709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: WARNING keystonemiddleware.auth_token [None req-88ec2085-4228-497c-a46b-37797563472d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:46:28.638617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: WARNING keystonemiddleware.auth_token [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:46:28.715430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: WARNING keystonemiddleware.auth_token [None req-88ec2085-4228-497c-a46b-37797563472d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:46:28.866541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: WARNING keystonemiddleware.auth_token [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:46:28.871864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: WARNING keystonemiddleware.auth_token [None req-5521cdaa-7bb6-4bda-a595-7617787ff563 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:46:28.877255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5617ce3ef9c0 pid: 123380 (default app) Mar 08 19:46:28.939968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: WARNING keystonemiddleware.auth_token [None req-88ec2085-4228-497c-a46b-37797563472d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:46:28.945229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: WARNING keystonemiddleware.auth_token [None req-88ec2085-4228-497c-a46b-37797563472d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:46:28.950743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5617ce3ef9c0 pid: 123381 (default app) Mar 08 19:47:09.935649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e8769aca-4a74-4865-bf3b-f5a41d7cd454 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Action: 'create', calling method: .version_select at 0x7f0706da61f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-455097897"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:10.300652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-545600775", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "networks": [{"uuid": "953e5cc6-6737-446c-9b5c-918a66dc8d23"}]}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:10.842050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] validate_networks() for [('953e5cc6-6737-446c-9b5c-918a66dc8d23', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:47:11.578746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e8769aca-4a74-4865-bf3b-f5a41d7cd454 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.019859 Mar 08 19:47:11.582303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1154 bytes} [Tue Mar 8 19:47:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3025 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 19:47:11.596090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4ef05d6c-9682-4f0a-908b-b95de1fbfd86 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7f1f0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:11.769814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4ef05d6c-9682-4f0a-908b-b95de1fbfd86 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c" status: 200 len: 344 microversion: 2.1 time: 0.181924 Mar 08 19:47:11.770585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:11 2022] GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c => generated 344 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:47:11.956731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0f1c0c21-7660-49ec-9b39-bc669ed926b5 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0706c7f4c0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:12.018269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0f1c0c21-7660-49ec-9b39-bc669ed926b5 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/591e1855-b1a5-43b9-a913-a2a22c675bdc" status: 200 len: 350 microversion: 2.1 time: 0.069526 Mar 08 19:47:12.019117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 3/3] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:11 2022] GET /compute/v2.1/os-volumes/591e1855-b1a5-43b9-a913-a2a22c675bdc => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:12.703926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:47:12.705089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:47:12.705756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:47:12.706341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:47:12.706916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:47:12.734275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:12.735050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:12.736201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:12.736994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:12.787063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-960bf31b-49f3-4740-ad33-7d6325169987 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7f9d0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:12.824962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Getting quotas for project abb03c05d95347c1a22833cddc763e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:12.834075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Getting quotas for user 62e7b75c64214847af001ba2e0c27334 and project abb03c05d95347c1a22833cddc763e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:12.861288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:47:12.879102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:47:12.886278 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-960bf31b-49f3-4740-ad33-7d6325169987 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c" status: 200 len: 345 microversion: 2.1 time: 0.105983 Mar 08 19:47:12.887042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 4/4] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:12 2022] GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:47:12.899693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8f6cc07e-9759-4082-9d83-dbf2e158f857 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Action: 'create', calling method: .version_select at 0x7f0706c7d040>, body: {"snapshot": {"volume_id": "d91d4347-caa3-4641-befd-9c4d2c1e0d6c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-579259895"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:13.028223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0191e0a8-6a5b-4ef1-b913-c502b58e83b5 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.346261 Mar 08 19:47:13.031667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1/5] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 19:47:13.049045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-51bc4ec3-66e0-40d3-a18f-d9d6afdd2c57 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:13.051247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-51bc4ec3-66e0-40d3-a18f-d9d6afdd2c57 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:13.383766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8f6cc07e-9759-4082-9d83-dbf2e158f857 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.489257 Mar 08 19:47:13.384361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 5/6] 10.222.0.45 () {60 vars in 1161 bytes} [Tue Mar 8 19:47:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:13.394262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2156797b-df56-4374-bd68-f685c3293699 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7fdc0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:13.542212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2156797b-df56-4374-bd68-f685c3293699 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 200 len: 286 microversion: 2.1 time: 0.151344 Mar 08 19:47:13.543754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Mar 8 19:47:13 2022] GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:47:13.554956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b5b11ce6-c22a-442e-9a06-dc4e3603317f tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7f820>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:13.636251 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b5b11ce6-c22a-442e-9a06-dc4e3603317f tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.086388 Mar 08 19:47:13.637448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1139 bytes} [Tue Mar 8 19:47:13 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:13.642980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c6862e14-9fda-4c5d-a20b-a4b3e2bbf0eb tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0706c7d280>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:13.730906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c6862e14-9fda-4c5d-a20b-a4b3e2bbf0eb tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ff5c54e3-c02d-4080-8775-af11f8774fc4" status: 200 len: 351 microversion: 2.1 time: 0.092038 Mar 08 19:47:13.748183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:13 2022] GET /compute/v2.1/os-volumes/ff5c54e3-c02d-4080-8775-af11f8774fc4 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:13.753739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2cf28e8a-075d-4451-a780-fe86da9903e1 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7f550>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:13.827020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2cf28e8a-075d-4451-a780-fe86da9903e1 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 200 len: 286 microversion: 2.1 time: 0.077637 Mar 08 19:47:13.828737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 9/10] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Mar 8 19:47:13 2022] GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:14.056352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-51bc4ec3-66e0-40d3-a18f-d9d6afdd2c57 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:14.083220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-51bc4ec3-66e0-40d3-a18f-d9d6afdd2c57 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1214 microversion: 2.1 time: 1.045676 Mar 08 19:47:14.095469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 2/11] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:13 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1214 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:14.842147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-326f00e0-934a-4f54-8560-e0fdd2c1bebf tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7fc10>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:14.915815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-326f00e0-934a-4f54-8560-e0fdd2c1bebf tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 200 len: 286 microversion: 2.1 time: 0.080435 Mar 08 19:47:14.916431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 10/12] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Mar 8 19:47:14 2022] GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:15.118114 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:15.118866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:15.128858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:15.133000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:15.134743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:15.137014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:15.519329 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:15.550336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0de230b7-6a52-4b21-9171-d99818a17fe8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1218 microversion: 2.1 time: 0.441727 Mar 08 19:47:15.551988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 3/13] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:15 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1218 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:15.930311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5bc9496b-efed-4db7-a306-412047e1eb1a tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7da60>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:15.995900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5bc9496b-efed-4db7-a306-412047e1eb1a tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 200 len: 286 microversion: 2.1 time: 0.071909 Mar 08 19:47:15.997529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 11/14] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Mar 8 19:47:15 2022] GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:16.568159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:16.568899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:16.579378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:16.579843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:16.581500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:16.581710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:16.839577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:16.854694 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5d208449-ebe1-42a2-9c69-7c1a53213576 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1218 microversion: 2.1 time: 0.289536 Mar 08 19:47:16.859266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 4/15] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:16 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:17.008762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dce08f1d-6631-44e8-877d-af124d5fa232 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7d160>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:17.064869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dce08f1d-6631-44e8-877d-af124d5fa232 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 200 len: 287 microversion: 2.1 time: 0.059704 Mar 08 19:47:17.065434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 12/16] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Mar 8 19:47:17 2022] GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:17.077994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e5852de6-47aa-4a05-af75-c27f4615c21b tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0705adc160>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:17.273382 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e5852de6-47aa-4a05-af75-c27f4615c21b tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 202 len: 0 microversion: 2.1 time: 0.200505 Mar 08 19:47:17.274216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 5/17] 10.222.0.45 () {58 vars in 1253 bytes} [Tue Mar 8 19:47:17 2022] DELETE /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:47:17.282583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-34313cad-6734-4963-9d8c-2232a4651258 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0706c7fca0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:17.352580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-34313cad-6734-4963-9d8c-2232a4651258 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 200 len: 286 microversion: 2.1 time: 0.073764 Mar 08 19:47:17.353886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Mar 8 19:47:17 2022] GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:17.613363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9e2e182f-c585-48e0-b6c6-10d861de100c tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0705a6aa60>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:17.733149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9e2e182f-c585-48e0-b6c6-10d861de100c tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/00572e56-9b27-41e6-af07-38843ac91aa5" status: 200 len: 350 microversion: 2.1 time: 0.122058 Mar 08 19:47:17.733742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 6/19] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:17 2022] GET /compute/v2.1/os-volumes/00572e56-9b27-41e6-af07-38843ac91aa5 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:17.745616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5021ad57-58e6-4343-88fc-25cb98b05718 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0706c7f310>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:17.874195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:17.875031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:17.906995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:17.907577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:17.912553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:17.914883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:17.949907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5021ad57-58e6-4343-88fc-25cb98b05718 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.208185 Mar 08 19:47:17.950636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 14/20] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Mar 8 19:47:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:17.970037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8a1a3ccb-f97d-42ba-89e7-1413cbcf7a33 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0706c7d790>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:18.236356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8a1a3ccb-f97d-42ba-89e7-1413cbcf7a33 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.275669 Mar 08 19:47:18.236959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 15/21] 10.222.0.45 () {58 vars in 1148 bytes} [Tue Mar 8 19:47:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:18.250933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2116b1aa-de6a-44b2-9a9d-8f6ce857874e tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0706c7d040>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:18.334348 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:18.343620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e3d27fd2-8f9f-4d72-ad11-4fa09ff10381 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1272 microversion: 2.1 time: 0.473819 Mar 08 19:47:18.361155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 7/22] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:17 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1272 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:18.366200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7437454e-eb05-4e4d-a97b-71cf50a6d692 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0705a84820>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:18.434663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-7437454e-eb05-4e4d-a97b-71cf50a6d692 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] HTTP exception thrown: Snapshot 4d8a0adc-87d3-41a3-bb4a-089656013ded could not be found. Mar 08 19:47:18.435390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7437454e-eb05-4e4d-a97b-71cf50a6d692 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Returning 404 to user: Snapshot 4d8a0adc-87d3-41a3-bb4a-089656013ded could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:47:18.436366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7437454e-eb05-4e4d-a97b-71cf50a6d692 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded" status: 404 len: 111 microversion: 2.1 time: 0.073925 Mar 08 19:47:18.437163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 8/23] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Mar 8 19:47:18 2022] GET /compute/v2.1/os-snapshots/4d8a0adc-87d3-41a3-bb4a-089656013ded => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:47:18.452910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a14e1cb7-7eb3-431c-b4d8-bb5b3cf2c2e9 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f07063c5430>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:18.525231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2116b1aa-de6a-44b2-9a9d-8f6ce857874e tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.278054 Mar 08 19:47:18.531832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 16/24] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Mar 8 19:47:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:18.536880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-de76f95c-6041-4fc5-85c3-031fbdc5c6f3 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0706c7ddc0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:18.649492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a14e1cb7-7eb3-431c-b4d8-bb5b3cf2c2e9 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c" status: 202 len: 0 microversion: 2.1 time: 0.206744 Mar 08 19:47:18.653228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 9/25] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:47:18 2022] DELETE /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:47:18.658777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eb1fbcdf-d57e-4681-8a2c-26cb13a0d866 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0705a84700>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:18.814825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eb1fbcdf-d57e-4681-8a2c-26cb13a0d866 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c" status: 200 len: 344 microversion: 2.1 time: 0.159918 Mar 08 19:47:18.815598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 10/26] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:18 2022] GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:47:18.822877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-de76f95c-6041-4fc5-85c3-031fbdc5c6f3 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.289602 Mar 08 19:47:18.823568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 17/27] 10.222.0.45 () {58 vars in 1166 bytes} [Tue Mar 8 19:47:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:47:18.838218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-02abed3c-16d0-46d7-a3ad-a80093ad902a tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0705a84ee0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:19.074211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-02abed3c-16d0-46d7-a3ad-a80093ad902a tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.240719 Mar 08 19:47:19.075378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 11/28] 10.222.0.45 () {58 vars in 1169 bytes} [Tue Mar 8 19:47:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:19.089020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-94aa3052-c33d-4047-adf1-05612cfc0ba3 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0706c7fa60>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:19.268586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-94aa3052-c33d-4047-adf1-05612cfc0ba3 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.183203 Mar 08 19:47:19.269245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 18/29] 10.222.0.45 () {58 vars in 1154 bytes} [Tue Mar 8 19:47:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:19.281477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b4141c63-ee91-4c2a-9460-2be2c45e5b08 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0705a8e9d0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:19.377570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:19.378685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:19.415076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:19.416115 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:19.417392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:19.418072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:19.545896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b4141c63-ee91-4c2a-9460-2be2c45e5b08 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.269201 Mar 08 19:47:19.546640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 12/30] 10.222.0.45 () {58 vars in 1187 bytes} [Tue Mar 8 19:47:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:19.560410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-69efea22-6f1b-413c-a32e-1c9cd09e2266 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] Calling method '.version_select at 0x7f0705a8ed30>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:19.829630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-69efea22-6f1b-413c-a32e-1c9cd09e2266 tempest-VolumesTestJSON-1210914239 tempest-VolumesTestJSON-1210914239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.272962 Mar 08 19:47:19.830567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 13/31] 10.222.0.45 () {58 vars in 1154 bytes} [Tue Mar 8 19:47:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:19.835259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c4925765-f44a-4ff7-b542-33607b01bbe8 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f07072b8c10>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:19.983095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-c4925765-f44a-4ff7-b542-33607b01bbe8 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] HTTP exception thrown: Volume d91d4347-caa3-4641-befd-9c4d2c1e0d6c could not be found. Mar 08 19:47:19.983987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c4925765-f44a-4ff7-b542-33607b01bbe8 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Returning 404 to user: Volume d91d4347-caa3-4641-befd-9c4d2c1e0d6c could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:47:19.985237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c4925765-f44a-4ff7-b542-33607b01bbe8 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c" status: 404 len: 109 microversion: 2.1 time: 0.153639 Mar 08 19:47:19.986172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 14/32] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:19 2022] GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:47:20.005962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-77d1bc05-a2d3-4c5f-b2f5-882f3ce35d6e tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0705adc160>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:20.129124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-77d1bc05-a2d3-4c5f-b2f5-882f3ce35d6e tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] HTTP exception thrown: Volume d91d4347-caa3-4641-befd-9c4d2c1e0d6c could not be found. Mar 08 19:47:20.129992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-77d1bc05-a2d3-4c5f-b2f5-882f3ce35d6e tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Returning 404 to user: Volume d91d4347-caa3-4641-befd-9c4d2c1e0d6c could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:47:20.130843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-77d1bc05-a2d3-4c5f-b2f5-882f3ce35d6e tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c" status: 404 len: 109 microversion: 2.1 time: 0.129586 Mar 08 19:47:20.131513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 15/33] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:47:20 2022] DELETE /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:47:20.140259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-64afc9cd-c556-40e9-aae4-757cadcfd8b5 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Calling method '.version_select at 0x7f0705a8e790>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:20.266823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-64afc9cd-c556-40e9-aae4-757cadcfd8b5 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] HTTP exception thrown: Volume d91d4347-caa3-4641-befd-9c4d2c1e0d6c could not be found. Mar 08 19:47:20.267986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-64afc9cd-c556-40e9-aae4-757cadcfd8b5 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] Returning 404 to user: Volume d91d4347-caa3-4641-befd-9c4d2c1e0d6c could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:47:20.270076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-64afc9cd-c556-40e9-aae4-757cadcfd8b5 tempest-VolumesSnapshotsTestJSON-1992361153 tempest-VolumesSnapshotsTestJSON-1992361153-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c" status: 404 len: 109 microversion: 2.1 time: 0.133255 Mar 08 19:47:20.272391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 16/34] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 19:47:20 2022] GET /compute/v2.1/os-volumes/d91d4347-caa3-4641-befd-9c4d2c1e0d6c => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:47:20.406988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:20.438355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7d40e601-fcc2-4393-aa16-022a8c446bfc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1272 microversion: 2.1 time: 1.064372 Mar 08 19:47:20.469697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 19/35] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:19 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1272 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:21.477239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:21.478269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:21.519499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:21.522467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:21.525006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:21.526649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:22.142828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:22.175584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b9b8e69f-fa5f-4e8e-be9b-9238434f80db tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1272 microversion: 2.1 time: 0.704901 Mar 08 19:47:22.193130 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 17/36] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:21 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1272 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:23.019564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0a59b402-549b-4481-b402-a98c03b791b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'create', calling method: .version_select at 0x7f0706c7fb80>, body: {"keypair": {"name": "tempest-keypair-1335905347"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:23.210410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:23.211085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:23.222495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:23.222959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:23.223753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:23.224190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:23.238755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-0a59b402-549b-4481-b402-a98c03b791b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:23.255235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-0a59b402-549b-4481-b402-a98c03b791b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for user 53cb58d77e454254a2ae77687df2c7fd and project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:23.646855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-0a59b402-549b-4481-b402-a98c03b791b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:23.652500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-0a59b402-549b-4481-b402-a98c03b791b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for user 53cb58d77e454254a2ae77687df2c7fd and project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:23.683530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0a59b402-549b-4481-b402-a98c03b791b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.185922 Mar 08 19:47:23.695943 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 20/37] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 19:47:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:23.922413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:23.956980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0b110b3c-88bd-43f6-a294-e7edd1f21329 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1272 microversion: 2.1 time: 0.746437 Mar 08 19:47:23.961156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 18/38] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:23 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1272 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:24.980496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:24.981725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:25.003596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:25.010252 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:25.012892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:25.013631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:25.324920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:25.339137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1d8c1499-775e-4d8f-a476-a95c8e22c9a9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1272 microversion: 2.1 time: 0.361840 Mar 08 19:47:25.344675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 21/39] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:24 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1272 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:26.359763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:26.360808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:26.372262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:26.372881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:26.373922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:26.376577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:27.917079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:27.930939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3c3901d7-9d4b-4114-9eec-4ad582964efb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 1.572742 Mar 08 19:47:27.934936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 19/40] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:26 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:28.949482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:28.950377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:28.969815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:28.976335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:28.978328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:28.980936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:29.399128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-565897fa-4eaa-4cb1-afca-fe3a54f6977c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'create', calling method: .version_select at 0x7f0706b11550>, body: {"keypair": {"name": "tempest-keypair-1932018804"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:29.444150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-565897fa-4eaa-4cb1-afca-fe3a54f6977c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:29.458856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-565897fa-4eaa-4cb1-afca-fe3a54f6977c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for user df63dc8dd51a4afbb03e84060ace90ee and project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:29.578317 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:29.588434 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-99d05f87-d7ef-4385-964c-48bad345f0b2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 0.643094 Mar 08 19:47:29.592793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 20/41] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:28 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:29.745650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-565897fa-4eaa-4cb1-afca-fe3a54f6977c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:29.794915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-565897fa-4eaa-4cb1-afca-fe3a54f6977c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for user df63dc8dd51a4afbb03e84060ace90ee and project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:29.864044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-565897fa-4eaa-4cb1-afca-fe3a54f6977c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.069425 Mar 08 19:47:29.865294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 22/42] 10.222.0.45 () {62 vars in 1198 bytes} [Tue Mar 8 19:47:28 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1073 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:47:30.480031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bf7f35fc-a04e-4a6c-bade-7607dad60804 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: .version_select at 0x7f0705a73f70>, body: {"keypair": {"name": "tempest-keypair-1950768704"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:30.564653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-bf7f35fc-a04e-4a6c-bade-7607dad60804 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:30.588747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-bf7f35fc-a04e-4a6c-bade-7607dad60804 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:30.609095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:30.610264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:30.628491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:30.643718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:30.657726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:30.661562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:31.722026 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-bf7f35fc-a04e-4a6c-bade-7607dad60804 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:31.730534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-bf7f35fc-a04e-4a6c-bade-7607dad60804 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:31.799603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bf7f35fc-a04e-4a6c-bade-7607dad60804 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.037349 Mar 08 19:47:31.800395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 21/43] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 19:47:29 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:31.947971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:31.955519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c13db701-8846-4726-810e-d03ececb949f tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 1.350337 Mar 08 19:47:31.959413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 23/44] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:30 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:32.955112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-19a71975-36ec-43dc-9c85-9c23fa73686c req-2dfa38f8-2fea-42bf-b57e-14e928ef63db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34", "tag": "78cde18a-66af-4a1f-80ad-8995e7b46bad"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:32.972881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:32.973881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:32.985752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:32.989632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:32.997776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:32.998407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:33.002418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-19a71975-36ec-43dc-9c85-9c23fa73686c req-2dfa38f8-2fea-42bf-b57e-14e928ef63db service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:33.011836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-19a71975-36ec-43dc-9c85-9c23fa73686c req-2dfa38f8-2fea-42bf-b57e-14e928ef63db service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:33.093310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-19a71975-36ec-43dc-9c85-9c23fa73686c req-2dfa38f8-2fea-42bf-b57e-14e928ef63db service nova] Creating event network-changed:78cde18a-66af-4a1f-80ad-8995e7b46bad for instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 on hv-cinder-83009 Mar 08 19:47:33.100628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-19a71975-36ec-43dc-9c85-9c23fa73686c req-2dfa38f8-2fea-42bf-b57e-14e928ef63db service nova] Acquired lock "compute-rpcapi-router" {{(pid=123381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 19:47:33.106009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31e42437-df3c-42a3-b9bd-0e57fbbd2cc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:33.106586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31e42437-df3c-42a3-b9bd-0e57fbbd2cc0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:33.108152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31e42437-df3c-42a3-b9bd-0e57fbbd2cc0 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:33.118785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31e42437-df3c-42a3-b9bd-0e57fbbd2cc0 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:33.138781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.compute.rpcapi [None req-31e42437-df3c-42a3-b9bd-0e57fbbd2cc0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 19:47:33.141463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31e42437-df3c-42a3-b9bd-0e57fbbd2cc0 None None] Releasing lock "compute-rpcapi-router" {{(pid=123381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 19:47:33.184663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-31e42437-df3c-42a3-b9bd-0e57fbbd2cc0 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.425467 Mar 08 19:47:33.185550 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 22/45] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:33.909964 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:33.925612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a746e8ea-845e-4dd6-995c-59c112faec0c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 0.956729 Mar 08 19:47:33.934980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 24/46] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:32 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:34.208857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-404237641", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac9a0f9f-89c1-4e71-af10-ae382be0f761"}], "security_groups": [{"name": "tempest-securitygroup--2016173937"}], "key_name": "tempest-keypair-1335905347", "user_data": "}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:34.805433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] validate_networks() for [('ac9a0f9f-89c1-4e71-af10-ae382be0f761', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:47:35.206744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1399272367", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:35.354174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] validate_networks() for [('e8886c69-71b5-4f2a-a8b1-45077b0e7696', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:47:36.321036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:47:36.322336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:47:36.322967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:47:36.323707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:47:36.324380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:47:36.341409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:36.343875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:36.345048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:36.348112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:36.398570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for project b21199b1cdf9475b8db163893c789545. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:36.414178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for user 53cb58d77e454254a2ae77687df2c7fd and project b21199b1cdf9475b8db163893c789545. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:36.444131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:47:36.450866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:47:36.562423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-685bf8a9-f9b2-43fe-ae24-330fc07195e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.360402 Mar 08 19:47:36.563072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:47:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:47:36.582903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:36.583665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:36.606017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:36.606558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:36.607407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:36.607857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:37.509087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:37.520820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dfda30c1-0387-43ce-bd44-5119d83cd0b4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 0.954682 Mar 08 19:47:37.521687 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:36 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:37.542708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f4fa37c6-0847-4f37-ac77-4e6dc20cca97 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:37.549106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f4fa37c6-0847-4f37-ac77-4e6dc20cca97 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:37.705283 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4fa37c6-0847-4f37-ac77-4e6dc20cca97 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:37.716968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f4fa37c6-0847-4f37-ac77-4e6dc20cca97 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1237 microversion: 2.1 time: 0.193917 Mar 08 19:47:37.717887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 25/49] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:37 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1237 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:38.445304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:47:38.446318 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:47:38.447727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:47:38.448313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:47:38.448890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:47:38.473612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:38.482846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:38.485898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:38.486490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:38.539259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:38.539938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:38.565639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:38.567497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:38.572521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:38.573200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:38.622845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Getting quotas for project 72ed260f86604db6ac28144af3dfb647. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:38.636853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Getting quotas for user 1c2b1802092d482fb413906082477860 and project 72ed260f86604db6ac28144af3dfb647. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:38.677403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:47:38.680233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:47:38.940597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5c32a74e-ca97-40fa-82bf-1189578360fc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.018865 Mar 08 19:47:38.944522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:47:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 4023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 19:47:38.952570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:38.954116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:39.027279 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:39.027931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:39.030952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:39.045100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:39.268442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:39.290113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a607dcd9-4698-4841-b736-d0f4165e5172 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1297 microversion: 2.1 time: 0.336702 Mar 08 19:47:39.290792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 26/51] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:38 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1297 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:39.319777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-831597253", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f5b26d-7786-4d76-b026-0184c6ebc557"}], "security_groups": [{"name": "tempest-securitygroup--1101955667"}], "key_name": "tempest-keypair-1932018804", "user_data": "}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:39.688157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:39.702003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f12434da-276f-4f9f-abfe-0a329da2db87 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 1.167958 Mar 08 19:47:39.717451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 26/52] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:38 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:39.722774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cfd49133-36b1-42c4-8d6b-d698e896ad43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:39.723603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cfd49133-36b1-42c4-8d6b-d698e896ad43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:39.836755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cfd49133-36b1-42c4-8d6b-d698e896ad43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:39.844666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cfd49133-36b1-42c4-8d6b-d698e896ad43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1222 microversion: 2.1 time: 0.125686 Mar 08 19:47:39.850476 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 27/53] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:39 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:39.899648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] validate_networks() for [('b3f5b26d-7786-4d76-b026-0184c6ebc557', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:47:39.934530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1642345188", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dfea349b-6bfd-41c2-92c4-062cebf33ab6"}], "security_groups": [{"name": "tempest-securitygroup--2025488656"}], "key_name": "tempest-keypair-1950768704", "user_data": "}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:40.218561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] validate_networks() for [('dfea349b-6bfd-41c2-92c4-062cebf33ab6', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:47:41.379271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:47:41.379814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:47:41.380155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:47:41.380652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:47:41.381064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:47:41.404717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:41.405201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:41.405981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:41.406425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:41.482026 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:47:41.482499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:47:41.482908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:47:41.483317 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:47:41.484007 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:47:41.501182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for project 2f8fc81146d843659f7b027db2238ff7. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:41.507653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:41.508140 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:41.510846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for user df63dc8dd51a4afbb03e84060ace90ee and project 2f8fc81146d843659f7b027db2238ff7. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:41.511345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:41.517182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:41.562254 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:47:41.571187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:47:41.585522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:41.596825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:41.628435 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:47:41.630871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:47:41.662407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7d99e98e-89da-414f-a78f-ea438d7e2a05 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.366319 Mar 08 19:47:41.667450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 27/54] 10.222.0.45 () {62 vars in 1187 bytes} [Tue Mar 8 19:47:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 19:47:41.703880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1573874441", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:41.767150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6bf50739-18f0-4f28-8706-076057cad599 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.836841 Mar 08 19:47:41.768102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 28/55] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:47:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 19:47:41.773315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:41.773935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:41.792989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:41.793460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:41.794274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:41.794722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:41.833695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] validate_networks() for [('e8886c69-71b5-4f2a-a8b1-45077b0e7696', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:47:42.274192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:42.285028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-302bd5c9-ef27-4658-8be4-059c734138e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1363 microversion: 2.1 time: 0.515803 Mar 08 19:47:42.285626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 29/56] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:41 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:42.311591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:42.312240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:42.330078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:42.330922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:42.332001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:42.332735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:43.075321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:43.083188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-de53304e-8ff9-401b-b442-46472b268d3e tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 0.789229 Mar 08 19:47:43.087770 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 30/57] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:42 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:43.129944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:43.130942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:43.156059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:43.157232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:43.158455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:43.159578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:43.327083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:43.340466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:43.342095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:43.344551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-91fab7b8-f410-4e2b-879c-cb5a22ddc058 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1333 microversion: 2.20 time: 0.254541 Mar 08 19:47:43.346022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 31/58] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:43 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1333 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:43.380073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:43.384473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:43.405385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:43.405917 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:43.406789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:43.409081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:43.637079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:43.646019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1943e21b-0c03-4979-9ca4-1cf37fd80264 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1302 microversion: 2.1 time: 0.297914 Mar 08 19:47:43.646600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 32/59] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:43 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1302 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:43.664603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:43.665219 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:43.682725 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:43.683187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:43.683980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:43.684463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:43.980617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:47:43.981626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:47:43.982353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:47:43.982877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:47:43.983404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:47:43.997034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.004864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.006117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.007881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.035523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Getting quotas for project 72ed260f86604db6ac28144af3dfb647. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:47:44.048043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Getting quotas for user 1c2b1802092d482fb413906082477860 and project 72ed260f86604db6ac28144af3dfb647. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:47:44.064238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:47:44.068416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:47:44.199452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2e25280f-414b-4abf-836c-e7e4930063b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.528445 Mar 08 19:47:44.207250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 28/60] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:47:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:47:44.320060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-dcd1a7a4-3dd7-46c4-acd2-ccb44792923f req-73a86be3-2d8d-46b3-b534-4e8f4b4a3336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34", "name": "network-vif-plugged", "status": "completed", "tag": "78cde18a-66af-4a1f-80ad-8995e7b46bad"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:44.352964 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-dcd1a7a4-3dd7-46c4-acd2-ccb44792923f req-73a86be3-2d8d-46b3-b534-4e8f4b4a3336 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.356006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-dcd1a7a4-3dd7-46c4-acd2-ccb44792923f req-73a86be3-2d8d-46b3-b534-4e8f4b4a3336 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.440489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-dcd1a7a4-3dd7-46c4-acd2-ccb44792923f req-73a86be3-2d8d-46b3-b534-4e8f4b4a3336 service nova] Creating event network-vif-plugged:78cde18a-66af-4a1f-80ad-8995e7b46bad for instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 on hv-cinder-83009 Mar 08 19:47:44.445481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-dcd1a7a4-3dd7-46c4-acd2-ccb44792923f req-73a86be3-2d8d-46b3-b534-4e8f4b4a3336 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 19:47:44.446874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94644d99-d7d2-485b-a93d-6c4703ee4883 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.449687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94644d99-d7d2-485b-a93d-6c4703ee4883 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.450760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94644d99-d7d2-485b-a93d-6c4703ee4883 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.454331 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94644d99-d7d2-485b-a93d-6c4703ee4883 None None] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.470361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.compute.rpcapi [None req-94644d99-d7d2-485b-a93d-6c4703ee4883 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 19:47:44.474446 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94644d99-d7d2-485b-a93d-6c4703ee4883 None None] Releasing lock "compute-rpcapi-router" {{(pid=123380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 19:47:44.508757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-94644d99-d7d2-485b-a93d-6c4703ee4883 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299964 Mar 08 19:47:44.513596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 29/61] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:44.519519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:44.520508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:44.529512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.530185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.531148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.531750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.849076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:44.861385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-138d9ee6-ebc1-4818-92a8-158f1c868762 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1363 microversion: 2.1 time: 1.213495 Mar 08 19:47:44.862020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 33/62] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:43 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1363 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:44.877344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:44.877997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:44.885232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.885789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:44.886781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:44.887289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:45.056437 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:45.069553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ae526973-4db9-4f56-a971-9151ba162ab1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1226 microversion: 2.1 time: 0.196718 Mar 08 19:47:45.070514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 34/63] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:44 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1226 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:45.076278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:45.079352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:45.085879 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:45.086484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:45.087654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:45.088103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:45.240875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:45.250576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:45.252808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:45.254167 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5ee7bc75-b30a-4b3a-8a4f-481d5c9b0627 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1339 microversion: 2.20 time: 0.182298 Mar 08 19:47:45.254726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 35/64] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:45 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:45.260628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-d58ef8cb-8b48-483f-bc98-3c0e6018bfa2 req-f64e411b-6036-4827-b177-25e5f6e5e73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477b451d-e030-4691-965c-19224d84c9b4", "tag": "deea1de1-999c-4b53-999a-016d7f51ba59"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:45.271585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-d58ef8cb-8b48-483f-bc98-3c0e6018bfa2 req-f64e411b-6036-4827-b177-25e5f6e5e73b service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:45.276056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-d58ef8cb-8b48-483f-bc98-3c0e6018bfa2 req-f64e411b-6036-4827-b177-25e5f6e5e73b service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:45.300151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-d58ef8cb-8b48-483f-bc98-3c0e6018bfa2 req-f64e411b-6036-4827-b177-25e5f6e5e73b service nova] Creating event network-changed:deea1de1-999c-4b53-999a-016d7f51ba59 for instance 477b451d-e030-4691-965c-19224d84c9b4 on hv-cinder-83009 Mar 08 19:47:45.306576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-d58ef8cb-8b48-483f-bc98-3c0e6018bfa2 req-f64e411b-6036-4827-b177-25e5f6e5e73b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049378 Mar 08 19:47:45.307849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 36/65] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:45.314542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:45.315946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:45.337824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:45.338847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:45.340708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:45.341342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:45.417631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:45.433199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a4045929-1ce7-4502-9c4d-450aeb161f74 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 0.917067 Mar 08 19:47:45.435109 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 30/66] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:44 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:45.486722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:45.505015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2ec86708-bb26-4d80-bdd1-ad88b8d4017d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1300 microversion: 2.1 time: 0.195790 Mar 08 19:47:45.507376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 37/67] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:45 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:45.879582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:45.881191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:45.893251 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:45.895665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:45.901404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:45.901404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.087592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:46.088274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:46.104829 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.106462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.107448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.107901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.276036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:46.296520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:46.298490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c89352f5-5095-4b03-946e-f9ddcdb51770 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1363 microversion: 2.1 time: 0.421977 Mar 08 19:47:46.305972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 31/68] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:45 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:46.311897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:46.312549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:46.322532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bdeb6627-bb63-4d10-ab3d-17a81cb01d1d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1280 microversion: 2.1 time: 0.238358 Mar 08 19:47:46.335944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 38/69] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:46 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:46.339493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.339970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.340815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.341258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.451749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:46.455666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:46.456580 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:46.465392 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.466237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.467342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.468319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.468747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:46.470506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:46.476338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b702e388-5668-487d-a4bf-a985c1568d88 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1339 microversion: 2.20 time: 0.164653 Mar 08 19:47:46.488866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 32/70] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:46 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:46.525774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:46.526379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:46.539023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.540330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.542941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:46.548415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:46.642734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:46.656844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e0478d2f-9dbf-4eca-a854-c074932c8ddb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1300 microversion: 2.1 time: 0.136245 Mar 08 19:47:46.661497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 33/71] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:46 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:47.227243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:47.236193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-752d3ef9-a556-4eab-a3e5-fd495823183c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1314 microversion: 2.1 time: 0.788905 Mar 08 19:47:47.246957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 39/72] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:46 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:47:47.321405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:47.323261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:47.334036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.336245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.336245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.336245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.340977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:47.342532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:47.358172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.358598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.359402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.359836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.638332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:47.647559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fc4081d9-c286-459d-b5cd-0ca5b31cc310 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1363 microversion: 2.1 time: 0.329383 Mar 08 19:47:47.648158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 34/73] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:47 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:47.663361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:47.667042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:47.681354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.682143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.683155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.690736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.947604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:47.956155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:47.958093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:47.959231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cdbb8079-b7d3-49af-a3fe-a6e65f7336be tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.301153 Mar 08 19:47:47.960441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 35/74] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:47 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:47.965435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:47.966207 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:47.972537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.973147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.977559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:47.981165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:47.988326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:48.000733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-85bf6e9e-8a10-416d-930e-525377962543 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1280 microversion: 2.1 time: 0.660144 Mar 08 19:47:48.002927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 40/75] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:47 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1280 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:47:48.210375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-8d4acd6b-4547-4c18-b3f5-e3419b06eaf9 req-f0b7a077-9320-4823-93eb-a6c61112f37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae2ebb6-0a33-4828-9401-549caf63b885", "tag": "3922c2b2-0487-47bb-b9e7-3f5915f09d4f"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:48.228794 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-8d4acd6b-4547-4c18-b3f5-e3419b06eaf9 req-f0b7a077-9320-4823-93eb-a6c61112f37a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:48.232612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-8d4acd6b-4547-4c18-b3f5-e3419b06eaf9 req-f0b7a077-9320-4823-93eb-a6c61112f37a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:48.236607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:48.250712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b91a872a-fe0d-4fa3-8762-6f57310f3044 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.287673 Mar 08 19:47:48.251792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-8d4acd6b-4547-4c18-b3f5-e3419b06eaf9 req-f0b7a077-9320-4823-93eb-a6c61112f37a service nova] Creating event network-changed:3922c2b2-0487-47bb-b9e7-3f5915f09d4f for instance aae2ebb6-0a33-4828-9401-549caf63b885 on hv-cinder-83009 Mar 08 19:47:48.252206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 36/76] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:47 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:48.261017 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:48.262043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:48.265151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-8d4acd6b-4547-4c18-b3f5-e3419b06eaf9 req-f0b7a077-9320-4823-93eb-a6c61112f37a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227161 Mar 08 19:47:48.265864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 41/77] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:48.275125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:48.276848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:48.278318 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:48.279624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:48.465293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:48.475550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2343168e-686f-4791-a5d9-b46a9b9b3ff7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1501 microversion: 2.1 time: 0.220424 Mar 08 19:47:48.477765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 37/78] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:48 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1501 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:48.667495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:48.668519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:48.677145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:48.678016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:48.679851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:48.680507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:48.978137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:48.978743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:48.989069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:48.989523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:48.990320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:48.991318 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:49.438143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:49.450970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:49.458049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f9e1ab5d-171d-4c2e-9f06-cfe240784beb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1363 microversion: 2.1 time: 0.796980 Mar 08 19:47:49.462839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 42/79] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:48 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1363 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:49.473418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:49.480105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:49.481641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ed4289a9-390a-4b30-bef8-56c4388d9dc1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.507797 Mar 08 19:47:49.483425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 38/80] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:48 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:49.488986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:49.492483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:49.512282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:49.514633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:49.515655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:49.518130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:49.520281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:49.526787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:49.561900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:49.565885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:49.567059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:49.575201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:49.768973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:49.778561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-254cd913-e2dc-4e31-a04d-320314c7b1bc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.293137 Mar 08 19:47:49.789381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 39/81] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:49 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:50.008120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a4566d5f-d356-4132-a310-0ca578518db4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a31ce13-a472-410e-9c3d-9ed42ea64dba"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:50.013959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a4566d5f-d356-4132-a310-0ca578518db4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:50.028897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4566d5f-d356-4132-a310-0ca578518db4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:50.031872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4566d5f-d356-4132-a310-0ca578518db4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:50.032744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4566d5f-d356-4132-a310-0ca578518db4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:50.035950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4566d5f-d356-4132-a310-0ca578518db4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:50.295406 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:50.306391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bb4c4f60-f999-4d8c-b8e3-8bbaf8c8dc1b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.841132 Mar 08 19:47:50.317741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 43/82] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:49 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:50.479306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:50.480070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:50.491622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:50.492088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:50.496191 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:50.496675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:50.733554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a4566d5f-d356-4132-a310-0ca578518db4 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "POST /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735549 Mar 08 19:47:50.735448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 40/83] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:47:49 2022] POST /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:47:50.746643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:50.766329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:50.790651 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:50.791693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:50.792532 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:50.797973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:51.171679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:51.185052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:51.188912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:51.190005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1768ecca-9122-4e7a-a568-4106499452f4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.451099 Mar 08 19:47:51.190569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 41/84] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:50 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:51.214817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:51.217507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:51.227196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:51.228071 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:51.229097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:51.229741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:51.651492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:51.660404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-00ecfb43-46dd-4c6b-a004-a3637840ddd9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.455221 Mar 08 19:47:51.663407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 42/85] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:51 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:51.669691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-d9ccdec0-2b16-4ee9-b34e-e718136a36b6 req-bfac14d3-75d4-4489-8302-8f146bce14e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a53ea32-1838-4dd1-85b7-bae137389683", "tag": "04a354b0-ebaf-4bb1-8bd4-8311d12fae7f"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:51.681391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-d9ccdec0-2b16-4ee9-b34e-e718136a36b6 req-bfac14d3-75d4-4489-8302-8f146bce14e0 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:51.682282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-d9ccdec0-2b16-4ee9-b34e-e718136a36b6 req-bfac14d3-75d4-4489-8302-8f146bce14e0 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:51.713368 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-d9ccdec0-2b16-4ee9-b34e-e718136a36b6 req-bfac14d3-75d4-4489-8302-8f146bce14e0 service nova] Creating event network-changed:04a354b0-ebaf-4bb1-8bd4-8311d12fae7f for instance 5a53ea32-1838-4dd1-85b7-bae137389683 on hv-cinder-83009 Mar 08 19:47:51.719841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-d9ccdec0-2b16-4ee9-b34e-e718136a36b6 req-bfac14d3-75d4-4489-8302-8f146bce14e0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054548 Mar 08 19:47:51.721113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 43/86] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:51.732117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:51.734076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:51.751681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:51.753804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:51.754782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:51.755327 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:51.890692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:51.906020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-be30230c-a746-4a04-be65-4a6d130c44cb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1363 microversion: 2.1 time: 1.430979 Mar 08 19:47:51.923765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 44/87] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:50 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1363 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:51.938898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-e5ee6d9a-e4ab-4d81-b8a3-249afef3ac5d req-dfe05706-f8a0-4000-85eb-b2cc328892a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b451d-e030-4691-965c-19224d84c9b4", "name": "network-vif-plugged", "status": "completed", "tag": "deea1de1-999c-4b53-999a-016d7f51ba59"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:51.956674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e5ee6d9a-e4ab-4d81-b8a3-249afef3ac5d req-dfe05706-f8a0-4000-85eb-b2cc328892a6 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:51.958310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e5ee6d9a-e4ab-4d81-b8a3-249afef3ac5d req-dfe05706-f8a0-4000-85eb-b2cc328892a6 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:51.976169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-e5ee6d9a-e4ab-4d81-b8a3-249afef3ac5d req-dfe05706-f8a0-4000-85eb-b2cc328892a6 service nova] Creating event network-vif-plugged:deea1de1-999c-4b53-999a-016d7f51ba59 for instance 477b451d-e030-4691-965c-19224d84c9b4 on hv-cinder-83009 Mar 08 19:47:51.984269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-e5ee6d9a-e4ab-4d81-b8a3-249afef3ac5d req-dfe05706-f8a0-4000-85eb-b2cc328892a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057309 Mar 08 19:47:51.985181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 45/88] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:52.117530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:52.125991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8bca42f1-637f-42a9-b644-0bd95a501e38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.402520 Mar 08 19:47:52.138500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 44/89] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:51 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:52.212076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:52.212817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:52.220753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:52.221732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:52.222515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:52.223052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:52.608645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:52.620668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:52.622262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:52.623296 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f4019eb1-505c-4df4-af6d-133ed4e56a08 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.418523 Mar 08 19:47:52.625268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 46/90] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:52 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:52.679581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:52.680268 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:52.686795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:52.687491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:52.688524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:52.689277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:52.830260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:52.838532 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d95215a0-3f89-4fbf-a8cc-76fe9ea97b46 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.162899 Mar 08 19:47:52.839102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 45/91] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:52 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:52.929367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:52.930694 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:52.939598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:52.940259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:52.941116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:52.941619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:53.149669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:53.150282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:53.162230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:53.166575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:53.168711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:53.172486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:53.497934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:53.505926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-00a7e65b-fb07-4964-99a1-cba9aed4afb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.364208 Mar 08 19:47:53.511568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 46/92] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:53 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:47:53.643306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:53.644873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:53.662002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:53.663370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:53.672028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:53.673303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:53.894098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:53.905476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:53.908376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:53.909918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1561db6d-f41f-46a3-aa8e-5bf6be68029c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.271772 Mar 08 19:47:53.911165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 47/93] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:53 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:53.917277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-95c4bda7-e6a1-4f68-8032-2bbbceace57c req-1010a47d-12dd-46e0-88d0-267fbb73d6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb7515f-c5d4-4330-a70a-c1835a5556c4", "tag": "38ecd555-5c0f-44c2-850e-97cbfeea62d4"}, {"name": "network-changed", "server_uuid": "4cfa0df4-9973-4370-a11d-492708232495", "tag": "dd0094c5-2d50-493d-af72-15d0f09deacf"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:53.929815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-95c4bda7-e6a1-4f68-8032-2bbbceace57c req-1010a47d-12dd-46e0-88d0-267fbb73d6f5 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:53.930667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-95c4bda7-e6a1-4f68-8032-2bbbceace57c req-1010a47d-12dd-46e0-88d0-267fbb73d6f5 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:53.957648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-95c4bda7-e6a1-4f68-8032-2bbbceace57c req-1010a47d-12dd-46e0-88d0-267fbb73d6f5 service nova] Creating event network-changed:38ecd555-5c0f-44c2-850e-97cbfeea62d4 for instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 on hv-cinder-83009 Mar 08 19:47:53.958169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-95c4bda7-e6a1-4f68-8032-2bbbceace57c req-1010a47d-12dd-46e0-88d0-267fbb73d6f5 service nova] Creating event network-changed:dd0094c5-2d50-493d-af72-15d0f09deacf for instance 4cfa0df4-9973-4370-a11d-492708232495 on hv-cinder-83009 Mar 08 19:47:53.971631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-95c4bda7-e6a1-4f68-8032-2bbbceace57c req-1010a47d-12dd-46e0-88d0-267fbb73d6f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058928 Mar 08 19:47:53.972573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 48/94] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:53.982952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:53.984334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:53.993623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:53.996008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:53.997097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:53.998235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:53.999020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:54.005333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a5efd0e3-0dd9-4a9a-ae77-32fd7a3e219e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1363 microversion: 2.1 time: 1.082052 Mar 08 19:47:54.016238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 47/95] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:52 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1363 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:54.196900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:54.217665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-03d81a5c-55e5-4049-aca1-deba14ae763b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.243042 Mar 08 19:47:54.230606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 49/96] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:53 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:54.527549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:54.528910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:54.535335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:54.536034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:54.537053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:54.537908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:54.882321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:54.891495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-75cce070-f574-4780-83b2-b962d9bd147e tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.368780 Mar 08 19:47:54.893067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 48/97] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:54 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:54.932143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:54.935576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:54.944382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:54.945370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:54.946302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:54.947378 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.023578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:55.023578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:55.033370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.034070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.038013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.038565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.247552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:55.270019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:55.275943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cbf3f68d-1244-4aa2-a18c-98aaab3487bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1550 microversion: 2.1 time: 0.258319 Mar 08 19:47:55.281968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:55.284275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:55.285920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a22ba222-8caa-4e62-bfbc-1b97560470f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.360831 Mar 08 19:47:55.287996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 49/98] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:55 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1550 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:47:55.297994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 50/99] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:54 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:47:55.304647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3086615b-4571-49a3-aa0c-ed9a2196d2f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:55.306075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3086615b-4571-49a3-aa0c-ed9a2196d2f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:55.307828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:55.308837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:55.312399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3086615b-4571-49a3-aa0c-ed9a2196d2f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.313074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3086615b-4571-49a3-aa0c-ed9a2196d2f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.314370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3086615b-4571-49a3-aa0c-ed9a2196d2f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.315026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3086615b-4571-49a3-aa0c-ed9a2196d2f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.326069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.326750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.328256 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.331151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.416677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3086615b-4571-49a3-aa0c-ed9a2196d2f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115880 Mar 08 19:47:55.417276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 51/100] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Mar 8 19:47:55 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:55.421800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-a00f8653-c2f3-4757-ad56-46a38fcd5a5c req-222c649e-2bdf-4336-b04b-5db1dc3a8eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae2ebb6-0a33-4828-9401-549caf63b885", "name": "network-vif-plugged", "status": "completed", "tag": "3922c2b2-0487-47bb-b9e7-3f5915f09d4f"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:55.430204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-a00f8653-c2f3-4757-ad56-46a38fcd5a5c req-222c649e-2bdf-4336-b04b-5db1dc3a8eda service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.430657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-a00f8653-c2f3-4757-ad56-46a38fcd5a5c req-222c649e-2bdf-4336-b04b-5db1dc3a8eda service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.441574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-a00f8653-c2f3-4757-ad56-46a38fcd5a5c req-222c649e-2bdf-4336-b04b-5db1dc3a8eda service nova] Creating event network-vif-plugged:3922c2b2-0487-47bb-b9e7-3f5915f09d4f for instance aae2ebb6-0a33-4828-9401-549caf63b885 on hv-cinder-83009 Mar 08 19:47:55.447004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-a00f8653-c2f3-4757-ad56-46a38fcd5a5c req-222c649e-2bdf-4336-b04b-5db1dc3a8eda service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028564 Mar 08 19:47:55.447839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 52/101] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:55.606072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:55.613402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ccb8fb16-c330-4b5b-8302-63b1b836827e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.323277 Mar 08 19:47:55.623590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 50/102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:55 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:55.909595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:55.910407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:55.918213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.918872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:55.919790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:55.920395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:56.305285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:56.305815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:56.311497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:56.311941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:56.312738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:56.313171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:56.342032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:56.350569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f7e488b9-f40f-4ae8-98c8-196ae75e6712 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.444809 Mar 08 19:47:56.351472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 53/103] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:55 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:56.467111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:56.475401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:56.476946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:56.478030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-10504ab4-8af3-4d72-97b1-84c0c8357f0f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.177407 Mar 08 19:47:56.478592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 51/104] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:56 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:47:56.630490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:56.631131 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:56.636925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:56.637366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:56.638118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:56.638546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:56.862791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:56.870006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b31ad08d-4e0a-483b-99f0-8b835a21d8db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.243285 Mar 08 19:47:56.870570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 54/105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:56 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:56.961569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-cfc275df-2c87-4973-8c4d-77033f87e1bd req-c6bf3dbf-9443-42f1-a268-7c233669dce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477b451d-e030-4691-965c-19224d84c9b4", "tag": "deea1de1-999c-4b53-999a-016d7f51ba59"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:47:56.969763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-cfc275df-2c87-4973-8c4d-77033f87e1bd req-c6bf3dbf-9443-42f1-a268-7c233669dce5 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:56.970212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-cfc275df-2c87-4973-8c4d-77033f87e1bd req-c6bf3dbf-9443-42f1-a268-7c233669dce5 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:56.981134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-cfc275df-2c87-4973-8c4d-77033f87e1bd req-c6bf3dbf-9443-42f1-a268-7c233669dce5 service nova] Creating event network-changed:deea1de1-999c-4b53-999a-016d7f51ba59 for instance 477b451d-e030-4691-965c-19224d84c9b4 on hv-cinder-83009 Mar 08 19:47:56.986019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-cfc275df-2c87-4973-8c4d-77033f87e1bd req-c6bf3dbf-9443-42f1-a268-7c233669dce5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028607 Mar 08 19:47:56.986611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 52/106] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:47:57.367615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:57.368427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:57.374528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:57.374973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:57.375751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:57.376190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:57.500143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:57.501470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:57.510527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:57.511683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:57.513451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:57.514075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:57.528593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:57.535938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6ece81e8-898b-4dd3-b4f0-d6b3091bd1e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.172869 Mar 08 19:47:57.536544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 55/107] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:57 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:57.672967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:57.684144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:57.685733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:57.686840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-21f83d6b-9551-469f-abf0-bb83e10c7744 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.193850 Mar 08 19:47:57.687616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 53/108] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:57 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:47:57.887052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:57.887948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:57.894292 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:57.894741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:57.895522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:57.895962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:58.034173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:58.042364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0f5a2a7c-e65f-438f-94c7-b0b58c2f7eca tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.159282 Mar 08 19:47:58.042937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 56/109] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:57 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:58.552775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:58.553925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:58.560384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:58.560833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:58.561860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:58.562291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:58.705270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:58.706539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:58.714505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:58.714956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:58.715746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:58.716186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:58.853148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:58.861002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:58.862509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:58.863798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f2c00484-2de0-4f43-9786-06ed6ad885cd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.162839 Mar 08 19:47:58.864385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 57/110] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:58 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:47:58.933272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:58.940319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f87fd6f5-ba47-4226-a2fb-ae8352741b2c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.391387 Mar 08 19:47:58.940888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 54/111] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:58 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:59.058913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:59.059451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:59.065241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:59.065687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:59.066441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:59.066872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:59.196887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:47:59.203994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fb74e991-6f76-4e7f-b3ff-06f08358105d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.148971 Mar 08 19:47:59.204569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 58/112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:59 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:47:59.882487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:59.887188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:59.889068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:59.889415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:59.890194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:59.890631 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:59.957074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:47:59.957808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:47:59.965773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:59.966334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:47:59.967114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:47:59.967551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:00.025561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:00.033446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:00.034955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:00.036043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-24733839-f9ff-4f3c-bf5a-92a8d3ca56ad tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.158278 Mar 08 19:48:00.036788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 55/113] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:47:59 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:00.121016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:00.128266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a8aafa4e-d2ea-4542-9ef0-f03135f2098b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.175071 Mar 08 19:48:00.128859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 59/114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:47:59 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:00.221303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:00.221922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:00.228181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:00.228658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:00.229416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:00.229850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:00.364829 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:00.372122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-06eb4bbf-5d70-4be5-bc8c-b96eca26d15f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.154540 Mar 08 19:48:00.372711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 56/115] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:00 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:01.054550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:01.055151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:01.061433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:01.061882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:01.062679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:01.063114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:01.146051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:01.146725 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:01.153367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:01.153809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:01.154598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:01.155025 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:01.197806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:01.205723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:01.207340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:01.208575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0157a7ad-7c3f-47e5-841a-a72218dd0232 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.158381 Mar 08 19:48:01.209133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 60/116] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:01 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:01.286443 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:01.294290 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-310aed98-0515-4f3f-8d0d-983e77001444 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.153101 Mar 08 19:48:01.294847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 57/117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:01 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:01.388658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:01.389271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:01.395028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:01.395482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:01.396253 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:01.396716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:01.527072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:01.534713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-343f3df9-e595-4459-b31a-a0b2ac9e45e3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.149789 Mar 08 19:48:01.535476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 61/118] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:01 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:02.226527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:02.227154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:02.232835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:02.233280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:02.234034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:02.234461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:02.314984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:02.316847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:02.348372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:02.348792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:02.349675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:02.352684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:02.383452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:02.394274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:02.395922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:02.397798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ac708d87-d497-4df8-90e2-427a7aeee172 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.175364 Mar 08 19:48:02.398488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 58/119] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:02 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:02.513045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:02.520478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-db3c72f7-8abc-464d-a55c-e26bc36eda4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.212502 Mar 08 19:48:02.521292 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 62/120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:02 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:02.552321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:02.553713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:02.559675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:02.560104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:02.561314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:02.561747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:02.732469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:02.742017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c77effaa-5500-4628-a7cf-3ac4a022c95e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.193576 Mar 08 19:48:02.744053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 59/121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:02 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:03.204320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-c3f93f8d-2ff7-46f7-aaba-c392d92f505c req-d9e691de-46b1-4b30-8c9e-27fcdfd8676b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfa0df4-9973-4370-a11d-492708232495", "name": "network-vif-plugged", "status": "completed", "tag": "dd0094c5-2d50-493d-af72-15d0f09deacf"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:48:03.212462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-c3f93f8d-2ff7-46f7-aaba-c392d92f505c req-d9e691de-46b1-4b30-8c9e-27fcdfd8676b service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:03.212985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-c3f93f8d-2ff7-46f7-aaba-c392d92f505c req-d9e691de-46b1-4b30-8c9e-27fcdfd8676b service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:03.223872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-c3f93f8d-2ff7-46f7-aaba-c392d92f505c req-d9e691de-46b1-4b30-8c9e-27fcdfd8676b service nova] Creating event network-vif-plugged:dd0094c5-2d50-493d-af72-15d0f09deacf for instance 4cfa0df4-9973-4370-a11d-492708232495 on hv-cinder-83009 Mar 08 19:48:03.229657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-c3f93f8d-2ff7-46f7-aaba-c392d92f505c req-d9e691de-46b1-4b30-8c9e-27fcdfd8676b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029218 Mar 08 19:48:03.230287 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 63/122] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:48:03.417469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:03.419551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:03.427867 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:03.428635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:03.430676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:03.431357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:03.538796 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:03.539658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:03.546177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:03.546840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:03.547933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:03.548477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:03.576945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:03.585365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:03.587120 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:03.588416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4b46f906-f678-451d-b3b1-2b533fe788c4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.177181 Mar 08 19:48:03.588972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 60/123] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:03 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:03.719144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:03.727139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a6d188c1-1240-4a58-b450-37cae0f951a1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.193586 Mar 08 19:48:03.735795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 64/124] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:03 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:03.759366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:03.760110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:03.766497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:03.767403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:03.768294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:03.770076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:03.929971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:03.937358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b1559e87-96e3-46f1-9bda-26cd7177c3a1 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.182332 Mar 08 19:48:03.937915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 61/125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:03 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:04.605783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:04.606417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:04.612646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:04.613096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:04.613859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:04.614329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:04.742887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:04.743523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:04.745714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:04.749394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:04.749838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:04.750598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:04.751028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:04.753389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:04.754909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:04.756544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0a68016c-bf45-4294-87d7-4721b6a1955f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.154164 Mar 08 19:48:04.757094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 65/126] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:04 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:04.887754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:04.895215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0304a2fd-1696-4ade-aaa3-77b80694c3bc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.156136 Mar 08 19:48:04.895783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 62/127] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:04 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:04.954077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:04.954686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:04.960506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:04.960962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:04.961729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:04.962169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:05.087936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:05.095119 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-96aa604b-2161-4d0e-8d6c-16133756dcd4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.144792 Mar 08 19:48:05.095686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 66/128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:04 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:05.250570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-61e1e106-88e2-4a51-94c7-9a5ee84806e8 req-2a40f095-926c-45b7-b8a3-7892a9c6f6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb7515f-c5d4-4330-a70a-c1835a5556c4", "name": "network-vif-plugged", "status": "completed", "tag": "38ecd555-5c0f-44c2-850e-97cbfeea62d4"}, {"server_uuid": "5a53ea32-1838-4dd1-85b7-bae137389683", "name": "network-vif-plugged", "status": "completed", "tag": "04a354b0-ebaf-4bb1-8bd4-8311d12fae7f"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:48:05.259211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-61e1e106-88e2-4a51-94c7-9a5ee84806e8 req-2a40f095-926c-45b7-b8a3-7892a9c6f6b3 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:05.259653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-61e1e106-88e2-4a51-94c7-9a5ee84806e8 req-2a40f095-926c-45b7-b8a3-7892a9c6f6b3 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:05.271899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-61e1e106-88e2-4a51-94c7-9a5ee84806e8 req-2a40f095-926c-45b7-b8a3-7892a9c6f6b3 service nova] Creating event network-vif-plugged:38ecd555-5c0f-44c2-850e-97cbfeea62d4 for instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 on hv-cinder-83009 Mar 08 19:48:05.272431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-61e1e106-88e2-4a51-94c7-9a5ee84806e8 req-2a40f095-926c-45b7-b8a3-7892a9c6f6b3 service nova] Creating event network-vif-plugged:04a354b0-ebaf-4bb1-8bd4-8311d12fae7f for instance 5a53ea32-1838-4dd1-85b7-bae137389683 on hv-cinder-83009 Mar 08 19:48:05.278762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-61e1e106-88e2-4a51-94c7-9a5ee84806e8 req-2a40f095-926c-45b7-b8a3-7892a9c6f6b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031893 Mar 08 19:48:05.279319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 63/129] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:48:05.774406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:05.774931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:05.781166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:05.781615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:05.782374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:05.782807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:05.913718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:05.915019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:05.919465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:05.923072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:05.923871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:05.924904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:05.925415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:05.927321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:05.929545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:05.930649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-245d1614-bb4c-4076-ad98-6bffa27653cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.160748 Mar 08 19:48:05.931354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 67/130] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:05 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:06.063985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:06.071098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-981aa101-3c95-4b2b-ae12-466497422ed4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.164073 Mar 08 19:48:06.071661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 64/131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:05 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:06.111747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:06.112405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:06.118897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:06.119345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:06.120105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:06.120570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:06.248163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:06.255455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f706039e-2847-4bc9-8a56-9d68e6bc2b2d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.147537 Mar 08 19:48:06.256037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 68/132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:06 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:06.948518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:06.949435 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:06.955519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:06.955912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:06.956837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:06.957272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.079909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:07.082125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:07.089103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.089695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.090644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.091223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.116700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:07.120874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:48:07.125800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:07.127458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:07.128750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bebe6fe4-d0a1-4d69-93fa-e333e9d1261c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.184162 Mar 08 19:48:07.139632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 65/133] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:06 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:07.144489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:07.145094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:07.151676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.152125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.152964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.153335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.257517 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dd542b11-6cb5-4715-9ea0-9eabb3c3a85a tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 204 len: 0 microversion: 2.1 time: 0.180494 Mar 08 19:48:07.258512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 69/134] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:48:07 2022] DELETE /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:48:07.268317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:07.269375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:07.277665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.278119 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.278948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.279386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.318319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:07.325489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0cd5db54-310e-4131-825c-5416a32c865a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.184806 Mar 08 19:48:07.326051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 66/135] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:07 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:07.330357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:07.330942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:07.336996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.337439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.338190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:07.338615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:07.421045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:07.429675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e6263037-415f-4c56-86f8-cd968c3654b9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.166484 Mar 08 19:48:07.430426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 70/136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:07 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:07.478003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:07.485613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dcdc8182-ea82-4d6b-b2c1-8ccf82eee2ce tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.158520 Mar 08 19:48:07.486180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 67/137] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:07 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:08.146543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:08.147236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:08.156428 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.157310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.158272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.158854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.344759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:08.346067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:08.356732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.357565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.358819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.359620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.558209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:08.566741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:08.569576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:08.570891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c7d0d32e-cd44-4c0a-b825-d9abbcb3e6dc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.428568 Mar 08 19:48:08.581208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 71/138] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:08 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:08.586367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:08.589217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:08.594528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:08.598233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.598705 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.601036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.601808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.609703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-800af5ba-cb90-45f7-a680-7aadaeddf8c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1322 microversion: 2.1 time: 0.271683 Mar 08 19:48:08.610564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 68/139] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:08 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:08.616096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:08.617711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:08.625327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.626215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.627619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:08.633161 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:08.787405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:08.795277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d65d4cef-f6fa-4d3e-8e52-cea6de22dad8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1368 microversion: 2.1 time: 0.183457 Mar 08 19:48:08.795557 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:08.805535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-39063845-b743-4270-9ae9-17d12972c898 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.231222 Mar 08 19:48:08.806319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 69/140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:08 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:08.806550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 72/141] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:08 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:09.589521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:09.590152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:09.596150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.596628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.597394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.597831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.626571 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:09.627181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:09.634119 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.634576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.635350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.636114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.733704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:09.741904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:09.743417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:09.744537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-68ad4339-c91e-4fce-82f0-a6832a650da8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.159591 Mar 08 19:48:09.745135 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 70/142] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:09 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:09.774265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:09.781910 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-58d1b730-cd30-43a9-a161-27accfc283b5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1516 microversion: 2.1 time: 0.159533 Mar 08 19:48:09.782574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 73/143] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:09 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:09.798812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:48:09.799815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:09.805632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.806081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.806845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.807285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.812949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:09.813679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:09.820248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.820898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.821669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.822101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.870378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lazy-loading 'flavor' on Instance uuid 4cfa0df4-9973-4370-a11d-492708232495 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:48:09.968750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:09.977899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-048cfe15-7781-46de-8944-e2e0de8ef341 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1559 microversion: 2.1 time: 0.168610 Mar 08 19:48:09.978670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 74/144] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:09 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:09.983938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:09.984819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:09.992869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.993507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:09.994394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:09.994902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:10.155370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:10.169617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-98ac7866-a1d1-48b7-b4ff-946805e2ba4d tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.189355 Mar 08 19:48:10.170221 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 75/145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:09 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:10.172060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b29eab7e-ac59-4d73-977b-dcf6dbfb6a38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495/action" status: 200 len: 32 microversion: 2.1 time: 0.377076 Mar 08 19:48:10.172792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 71/146] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:48:09 2022] POST /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495/action => generated 32 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:48:10.174862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3b2f3d4e-98a7-42e4-a624-f88cfe26dfab tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:10.175340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3b2f3d4e-98a7-42e4-a624-f88cfe26dfab tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:10.182548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:10.183564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:10.185634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d4e-98a7-42e4-a624-f88cfe26dfab tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:10.186189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d4e-98a7-42e4-a624-f88cfe26dfab tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:10.187102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d4e-98a7-42e4-a624-f88cfe26dfab tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:10.187536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d4e-98a7-42e4-a624-f88cfe26dfab tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:10.190454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:10.190908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:10.191761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:10.192248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:10.271381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3b2f3d4e-98a7-42e4-a624-f88cfe26dfab tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100066 Mar 08 19:48:10.271990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 76/147] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Mar 8 19:48:10 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:48:10.327032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:10.334813 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2084b772-125a-458f-8e42-c7961cb54620 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.156387 Mar 08 19:48:10.335538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 72/148] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:10 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:10.763949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:10.764677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:10.770612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:10.771183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:10.772844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:10.773280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:11.026594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:11.034441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:11.035958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:11.037135 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a656b21b-36e1-429c-a456-a09e0a2af332 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.278075 Mar 08 19:48:11.037706 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 77/149] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:10 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:11.186861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:11.188002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:11.194148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:11.194749 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:11.195696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:11.196345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:11.305191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-6f9e9886-4bca-40c4-b221-6fa21830aed6 req-69ca8e00-8561-4dd8-b5a7-b300b7a83d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a53ea32-1838-4dd1-85b7-bae137389683", "tag": "04a354b0-ebaf-4bb1-8bd4-8311d12fae7f"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:48:11.313236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-6f9e9886-4bca-40c4-b221-6fa21830aed6 req-69ca8e00-8561-4dd8-b5a7-b300b7a83d71 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:11.313680 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-6f9e9886-4bca-40c4-b221-6fa21830aed6 req-69ca8e00-8561-4dd8-b5a7-b300b7a83d71 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:11.325542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-6f9e9886-4bca-40c4-b221-6fa21830aed6 req-69ca8e00-8561-4dd8-b5a7-b300b7a83d71 service nova] Creating event network-changed:04a354b0-ebaf-4bb1-8bd4-8311d12fae7f for instance 5a53ea32-1838-4dd1-85b7-bae137389683 on hv-cinder-83009 Mar 08 19:48:11.330920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-6f9e9886-4bca-40c4-b221-6fa21830aed6 req-69ca8e00-8561-4dd8-b5a7-b300b7a83d71 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030782 Mar 08 19:48:11.331510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 78/150] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:48:11.338407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:11.346105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-89c4826a-82a2-4683-8b0a-bcaf749d50eb tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.163180 Mar 08 19:48:11.346667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 73/151] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:11 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:11.359209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:11.360037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:11.366781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:11.367348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:11.368195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:11.368760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:11.498979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:11.506271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8206f107-6d16-4cc3-b450-d22f01aabb1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.151628 Mar 08 19:48:11.506928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 79/152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:11 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:12.055442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:12.056045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:12.062011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:12.062456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:12.063215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:12.063649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:12.201412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:12.209604 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:12.211115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:12.212216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e8356554-a7e6-4e2a-9d8e-0e82f3c00d70 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1407 microversion: 2.20 time: 0.161260 Mar 08 19:48:12.212801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 74/153] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:12 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:12.364481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:12.365275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:12.373229 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:12.373767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:12.375076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:12.375626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:12.525151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:12.525757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:12.527518 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:12.532669 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:12.533330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:12.534258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:12.534839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:12.542312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-16a5bea9-1fce-4064-ad94-9f79b9f1281c tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.183131 Mar 08 19:48:12.553099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 80/154] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:12 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:13.023253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:13.030707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-676e453c-4614-4473-b235-5b98315befdb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.511292 Mar 08 19:48:13.031361 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 75/155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:12 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:13.229322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:13.229932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:13.238766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:13.239298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:13.240925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:13.241387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:13.399543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:13.407841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:13.409300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:13.410447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6dec3f29-2e4f-459c-9e10-6f2c33e7166e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1599 microversion: 2.20 time: 0.185119 Mar 08 19:48:13.418794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 81/156] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:48:13 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:48:13.430368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-65c41197-f0d0-4d6b-9c60-2df0768214bb tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:13.431195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-65c41197-f0d0-4d6b-9c60-2df0768214bb tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:13.437855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-65c41197-f0d0-4d6b-9c60-2df0768214bb tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:13.438574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-65c41197-f0d0-4d6b-9c60-2df0768214bb tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:13.439647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-65c41197-f0d0-4d6b-9c60-2df0768214bb tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:13.440183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-65c41197-f0d0-4d6b-9c60-2df0768214bb tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:13.560010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:13.560654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:13.566674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:13.567127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:13.568114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:13.568754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:13.742306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-65c41197-f0d0-4d6b-9c60-2df0768214bb tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.316115 Mar 08 19:48:13.742923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 76/157] 10.222.0.45 () {60 vars in 1315 bytes} [Tue Mar 8 19:48:13 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:48:13.753156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:13.761134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-01bf8822-ebce-4d57-bf6f-e4970f885daf tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.205602 Mar 08 19:48:13.761795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 82/158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:13 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:48:14.048127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:14.048826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:14.055306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:14.055806 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:14.056993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:14.057468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:14.586632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:14.594078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f7b3ad25-8389-402d-96b5-b9a4dd295e89 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.550565 Mar 08 19:48:14.594654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 77/159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:14 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:14.778697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:14.779308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:14.786394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:14.786936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:14.787721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:14.788333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:14.933572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:14.942271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dbed904f-0b82-41f0-a113-c8818a8834b0 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.167664 Mar 08 19:48:14.943080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 83/160] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:14 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:15.587367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-80131b68-3735-4de6-ae4f-121d65a08384 req-53bfdaf1-00a7-4e80-b9f6-55384926759c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb7515f-c5d4-4330-a70a-c1835a5556c4", "tag": "38ecd555-5c0f-44c2-850e-97cbfeea62d4"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:48:15.595863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-80131b68-3735-4de6-ae4f-121d65a08384 req-53bfdaf1-00a7-4e80-b9f6-55384926759c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:15.596326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-80131b68-3735-4de6-ae4f-121d65a08384 req-53bfdaf1-00a7-4e80-b9f6-55384926759c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:15.607482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-80131b68-3735-4de6-ae4f-121d65a08384 req-53bfdaf1-00a7-4e80-b9f6-55384926759c service nova] Creating event network-changed:38ecd555-5c0f-44c2-850e-97cbfeea62d4 for instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 on hv-cinder-83009 Mar 08 19:48:15.610653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:15.611256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:15.612657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-80131b68-3735-4de6-ae4f-121d65a08384 req-53bfdaf1-00a7-4e80-b9f6-55384926759c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029391 Mar 08 19:48:15.613370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 78/161] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:48:15.617942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:15.618453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:15.619588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:15.620088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:15.749726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:15.756992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ca7301aa-e835-47f1-807a-cc6d4936940c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.150129 Mar 08 19:48:15.757566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 84/162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:15 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:15.959551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:15.960270 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:15.966412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:15.966938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:15.967783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:15.968318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:16.121801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:16.129683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1ba0655d-22d6-42ad-9bcb-1609439e77cc tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1553 microversion: 2.1 time: 0.174309 Mar 08 19:48:16.130257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 79/163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:15 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:16.774356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:16.774963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:16.781296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:16.781745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:16.782518 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:16.782956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:16.914219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:16.921744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9753e263-60d4-41fa-8965-a1fc8e5b8ea4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.151803 Mar 08 19:48:16.922328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 85/164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:16 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:17.147454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:17.148255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:17.154216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:17.154608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:17.155535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:17.156315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:17.214223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:17.221910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9d1f0778-0f96-4d89-99c3-284d7e0442b7 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1511 microversion: 2.1 time: 0.079375 Mar 08 19:48:17.222462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 80/165] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:17 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1511 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:17.631316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-52c78305-0257-4eb9-8864-416fd4485676 req-11a7286c-bf9a-473f-8cab-7ca3bd150cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34", "name": "network-vif-deleted", "tag": "78cde18a-66af-4a1f-80ad-8995e7b46bad"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:48:17.639034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-52c78305-0257-4eb9-8864-416fd4485676 req-11a7286c-bf9a-473f-8cab-7ca3bd150cdc service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:17.639477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-52c78305-0257-4eb9-8864-416fd4485676 req-11a7286c-bf9a-473f-8cab-7ca3bd150cdc service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:17.649847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-52c78305-0257-4eb9-8864-416fd4485676 req-11a7286c-bf9a-473f-8cab-7ca3bd150cdc service nova] Creating event network-vif-deleted:78cde18a-66af-4a1f-80ad-8995e7b46bad for instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 on hv-cinder-83009 Mar 08 19:48:17.654609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-52c78305-0257-4eb9-8864-416fd4485676 req-11a7286c-bf9a-473f-8cab-7ca3bd150cdc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027552 Mar 08 19:48:17.655191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 86/166] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:48:17.938529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:17.939137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:17.945217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:17.945672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:17.946444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:17.947073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:18.090957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:18.098977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-25478180-4e54-4189-82d8-1e28f6ecd550 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.164396 Mar 08 19:48:18.099568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 81/167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:17 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:18.239566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:18.240263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:18.246167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:18.246616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:18.247387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:18.247824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:18.281267 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:18.281724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:18.282185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lazy-loading 'fault' on Instance uuid 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:48:18.337853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7b75c64214847af001ba2e0c27334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb03c05d95347c1a22833cddc763e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:18.346255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-235c516f-28cc-4046-a5aa-bb8e6ec480c2 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 200 len: 1350 microversion: 2.1 time: 0.111206 Mar 08 19:48:18.347389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 87/168] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:18 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 1350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:19.120109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:19.120885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:19.126856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:19.127311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:19.128075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:19.128559 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:19.259087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:19.268872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0563b545-e94c-41dc-b806-478be2baefae tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.156926 Mar 08 19:48:19.275874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 82/169] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:19 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:19.366786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:19.367749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:19.375147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:19.376277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:19.377266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:19.377851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:19.394689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] HTTP exception thrown: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. Mar 08 19:48:19.395349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Returning 404 to user: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:48:19.396931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f70070e4-dd2b-47f4-a40c-ef61503b9ce8 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 404 len: 111 microversion: 2.1 time: 0.035431 Mar 08 19:48:19.416422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 88/170] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:19 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:48:19.507415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:19.508990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:19.515546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:19.516052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:19.516987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:19.517410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:19.531221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] HTTP exception thrown: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. Mar 08 19:48:19.531820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Returning 404 to user: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:48:19.533004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-18798252-a267-43de-b644-43cbab49f2f9 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030945 Mar 08 19:48:19.533942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 83/171] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:48:19 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:48:20.286080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:20.286817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:20.293042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:20.293496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:20.294254 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:20.294689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:20.431365 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:20.438828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ef979466-9bb7-4943-aed7-2d92212598e6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.156578 Mar 08 19:48:20.439318 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 89/172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:20 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:21.456407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:21.456963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:21.462765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:21.463210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:21.463972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:21.464427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:21.605346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:21.612680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-22d39bfb-42ad-4048-9157-37a2460c2234 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.160299 Mar 08 19:48:21.613239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 84/173] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:21 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:22.629907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:22.630536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:22.636777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:22.637224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:22.637988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:22.638422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:22.771794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:22.778999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-56ef9e04-996f-4894-8bb0-8f04b5c2880d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.152934 Mar 08 19:48:22.779568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 90/174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:22 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:23.796226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:23.796863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:23.802709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:23.803163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:23.803932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:23.804419 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:23.935184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:23.942919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-77f02d44-65b0-46ed-ada8-f7a22df6094a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.150225 Mar 08 19:48:23.943332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 85/175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:23 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:24.959703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:24.960335 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:24.967396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:24.967878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:24.968686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:24.969249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:25.100111 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:25.108001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5e8771df-8ad3-4eea-a1fe-6e47f085b3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.152189 Mar 08 19:48:25.108588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 91/176] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:24 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:26.124541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:26.125146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:26.131223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:26.131800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:26.132611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:26.133046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:26.264957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:26.272199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a24b2863-124d-4d22-9dc4-aeff4f1960b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.151533 Mar 08 19:48:26.272792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 86/177] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:26 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:27.289527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:27.290086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:27.297163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:27.297618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:27.298385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:27.298823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:27.427810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:27.435078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-79c19721-c4f5-415b-98f6-e4306215a557 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.149498 Mar 08 19:48:27.435673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 92/178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:27 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:28.451589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:28.452220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:28.458072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:28.458454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:28.459204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:28.459632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:28.586776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:28.593864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bb322134-2adc-454e-8967-f7271e6b2c43 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.146119 Mar 08 19:48:28.594418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 87/179] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:28 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:29.610340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:29.611099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:29.617285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:29.617733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:29.618506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:29.618941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:29.756033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:29.763913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bdaa7b67-1201-498e-ae16-3188f9ab4f4d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.157409 Mar 08 19:48:29.764520 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 93/180] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:29 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:30.236152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:30.237461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:30.261552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:30.262177 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:30.264782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:30.265298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:30.286440 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] HTTP exception thrown: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. Mar 08 19:48:30.287394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Returning 404 to user: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:48:30.288560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c2b4bfad-bbc4-44f1-997c-9df70253988b tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 404 len: 111 microversion: 2.1 time: 0.061018 Mar 08 19:48:30.289471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 88/181] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:48:30 2022] DELETE /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:48:30.298729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:30.299513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] [instance: 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:30.307558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:30.308793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:30.309845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:30.310259 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:30.327675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] HTTP exception thrown: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. Mar 08 19:48:30.328410 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] Returning 404 to user: Instance 5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:48:30.329878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-02aabf0c-c9f8-4fc9-917f-6a9404dc2174 tempest-DeleteServersTestJSON-1849059892 tempest-DeleteServersTestJSON-1849059892-project] 10.222.0.45 "GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34" status: 404 len: 111 microversion: 2.1 time: 0.035567 Mar 08 19:48:30.330693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 94/182] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:30 2022] GET /compute/v2.1/servers/5b2e87f9-fdfb-4f89-91e6-1ebcc1ed3a34 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:48:30.780667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:30.781418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:30.787456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:30.787982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:30.788862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:30.789385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:31.117382 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:31.125952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-910f6a69-d33f-4f2a-bb96-05cdc9acf904 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.349087 Mar 08 19:48:31.126717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 89/183] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:30 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:32.142875 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:32.143486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:32.149608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:32.150061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:32.150828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:32.151285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:32.286199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:32.297146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5901659a-18a0-4d04-9865-a980ddf957af tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.158017 Mar 08 19:48:32.297845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 95/184] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:32 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:33.313884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:33.314406 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:33.320526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:33.320976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:33.321745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:33.322177 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:33.456762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:33.464022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-926525ee-fa88-4d34-aef0-951462549c4b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.154064 Mar 08 19:48:33.464617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 90/185] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:33 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:34.483393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:34.484004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:34.492205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:34.492690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:34.493627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:34.494216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:34.654074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:34.661297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3ea62070-8797-4882-bbf6-0fdf849bef8b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.184483 Mar 08 19:48:34.661842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 96/186] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:34 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:35.678735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:35.679610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:35.685855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:35.686299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:35.687123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:35.687478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:35.822266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:35.829605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-10686c12-67b8-4420-a49b-e63fa48c65ba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.154692 Mar 08 19:48:35.830238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 91/187] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:35 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:36.847434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:36.848043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:36.854434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:36.854918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:36.855701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:36.856135 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:36.993197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:37.001440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-49ccc2dc-2216-41e8-b41d-06de9b5bd890 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.157807 Mar 08 19:48:37.010419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 97/188] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:36 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:38.018179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:38.018788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:38.024901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:38.025342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:38.026115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:38.026549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:38.193640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:38.202226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9289514d-39e6-4d19-9526-68029a4443a3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.188177 Mar 08 19:48:38.202795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 92/189] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:38 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:39.220154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:39.220956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:39.229907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:39.231565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:39.233105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:39.234043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:39.435681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:39.447137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ceb2a9dc-c63d-432f-9b73-1c302d8438f5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.232072 Mar 08 19:48:39.447897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 98/190] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:39 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:40.465412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:40.467045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:40.474845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:40.476203 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:40.477200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:40.477800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:40.702344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:40.711235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-13b93f67-0dbc-4655-af62-9c4b1a95eac9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.250444 Mar 08 19:48:40.712085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 93/191] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:40 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:41.728738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:41.729837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:41.738254 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:41.738702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:41.739472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:41.739922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:41.882466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:41.890325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e7574006-d7d1-45f4-a476-12c8da92c357 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.165494 Mar 08 19:48:41.891063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 99/192] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:41 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:42.907490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:42.908220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:42.914308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:42.914753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:42.915778 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:42.916540 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:43.080352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:43.088733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-413996e5-2a75-4883-b651-bb7368d3409d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.185551 Mar 08 19:48:43.089404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 94/193] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:42 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:44.107106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:44.107860 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:44.114462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:44.114921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:44.115701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:44.116137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:44.255406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:44.263191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8615df79-b64c-48f5-af36-2576322a3806 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.160902 Mar 08 19:48:44.272343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 100/194] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:44 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:45.279649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:45.280307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:45.286135 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:45.286583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:45.287347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:45.287782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:45.422820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:45.430022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-beb32227-c8fa-42f4-b54d-8fb5e575224f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.154147 Mar 08 19:48:45.430582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 95/195] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:45 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:46.446236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:46.446930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:46.454990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:46.455440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:46.456203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:46.456670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:46.583921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:46.591703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-358c928d-394a-4686-a98e-741c7337d991 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.149502 Mar 08 19:48:46.592258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 101/196] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:46 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:47.609183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:47.609793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:47.615577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:47.616027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:47.616825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:47.617263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:47.746384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:47.753677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7564fdae-f633-412d-a1f3-8338b5d45b26 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.148964 Mar 08 19:48:47.754240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 96/197] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:47 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:48.770768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:48.771367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:48.777500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:48.777941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:48.778713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:48.779139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:48.911746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:48.920095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e159ca15-e3ff-4744-9bbb-38789e0dadc9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.153208 Mar 08 19:48:48.920681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 102/198] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:48 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:49.936883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:49.937493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:49.943269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:49.943718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:49.944519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:49.944949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:50.074521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:50.082229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-19546f5a-6f5b-48d6-b52d-4cbde5e08295 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.149420 Mar 08 19:48:50.082783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 97/199] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:49 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:51.098401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:51.099009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:51.104967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:51.105460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:51.106419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:51.106895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:51.235142 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:51.242354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e2bd84b8-cd7c-42dc-bb1c-68c439651acb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.147882 Mar 08 19:48:51.242917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 103/200] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:51 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:52.259455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:52.260070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:52.265838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:52.266289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:52.267057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:52.267494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:52.400747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:52.407919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fb2da044-9c77-436b-8702-11dce3b422b2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.152513 Mar 08 19:48:52.408499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 98/201] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:52 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:53.423974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:53.424692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:53.431127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:53.431652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:53.432696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:53.433208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:53.572648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:53.580424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-885e7cd5-7090-4d21-80c6-b893887d5ec3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.160207 Mar 08 19:48:53.580984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 104/202] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:53 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:54.602905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:54.603694 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:54.611601 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:54.612692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:54.613664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:54.614299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:54.814018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:54.822319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ba939e74-f349-4564-bcf4-9191ad0eea84 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.227941 Mar 08 19:48:54.833828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 99/203] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:54 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:55.842147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:55.845382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:55.857730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:55.858425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:55.859418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:55.860064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:56.158051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:56.167529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-13e1afe7-c79c-4ebc-b102-eb6c3457f00a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1522 microversion: 2.1 time: 0.330716 Mar 08 19:48:56.168651 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 105/204] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:55 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:57.186199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:57.188103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:57.194610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:57.195369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:57.196438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:57.197573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:57.462316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:57.470097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-10557c84-bcc3-4fde-9717-33f195b824c1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1502 microversion: 2.1 time: 0.288682 Mar 08 19:48:57.484795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 100/205] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:57 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:57.491622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:57.492891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:57.502402 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:57.503735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:57.517624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:57.519106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:57.933834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:48:57.961449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1ed3e8b8-91c6-4bb5-af30-480812b4ae39 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1517 microversion: 2.1 time: 0.467267 Mar 08 19:48:57.962423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 106/206] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:57 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1517 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:48:59.642650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:48:59.643597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:59.654805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:59.655284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:59.656152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:59.656781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:59.706949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lazy-loading 'flavor' on Instance uuid aae2ebb6-0a33-4828-9401-549caf63b885 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:48:59.859967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2a2326e-0e67-47be-a504-dcc662d431b8 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action" status: 200 len: 32 microversion: 2.1 time: 0.221345 Mar 08 19:48:59.866034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 101/207] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:48:59 2022] POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:48:59.873667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:48:59.874316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:48:59.882473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:59.882473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:48:59.883768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:48:59.884274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:00.178957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:00.188218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3778b5f6-9964-47d5-90f6-4c0dc7cf16e4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.321042 Mar 08 19:49:00.191649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 107/208] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:48:59 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:01.210572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:01.211834 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:01.245902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:01.246453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:01.248718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:01.249293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:01.572645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:01.584188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-807def27-5588-4c90-a2a5-27a6a020a799 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.377391 Mar 08 19:49:01.590280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 102/209] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:01 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:02.601187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:02.601781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:02.607988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:02.608488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:02.609268 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:02.609721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:02.756541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:02.764963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e963b7ac-32ea-47c6-a658-742e50f837c2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.167588 Mar 08 19:49:02.765896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 108/210] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:02 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:03.789499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:03.791172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:03.798377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:03.800204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:03.801341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:03.802124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:04.199070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:04.210139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-38a3633b-3969-49da-99d6-8a3b69c865a4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.432087 Mar 08 19:49:04.211661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 103/211] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:03 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:05.093181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2a88b1e7-1c17-4157-a5fe-f54131fb40f5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:05.094796 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2a88b1e7-1c17-4157-a5fe-f54131fb40f5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:05.117002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a88b1e7-1c17-4157-a5fe-f54131fb40f5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:05.119969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a88b1e7-1c17-4157-a5fe-f54131fb40f5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:05.134732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a88b1e7-1c17-4157-a5fe-f54131fb40f5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:05.135654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a88b1e7-1c17-4157-a5fe-f54131fb40f5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:05.209646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2a88b1e7-1c17-4157-a5fe-f54131fb40f5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/ips" status: 200 len: 147 microversion: 2.1 time: 0.122325 Mar 08 19:49:05.211185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 109/212] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:49:05 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/ips => generated 147 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:05.234835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:05.237654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:05.249675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:05.250132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:05.250913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:05.251454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:05.673577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:05.700195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5c8189a4-02d6-461c-9724-ca0792ae3995 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.476393 Mar 08 19:49:05.702124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 104/213] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:05 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:06.718788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:06.720120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:06.737493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:06.739262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:06.743131 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:06.745817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:07.071877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:07.080751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-150ac524-a822-4e2e-8c22-c2f5f9fcd7f9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.366358 Mar 08 19:49:07.084764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 110/214] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:06 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:08.098869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:08.100275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:08.116544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:08.120428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:08.122850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:08.123297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:08.817021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:08.835742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-98eb351b-bc6b-462e-8e11-1e9820373f81 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.736992 Mar 08 19:49:08.836654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 105/215] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:08 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:09.500189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ad0effef-8ff8-4d06-9bee-7b641ff3adde tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:09.500734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ad0effef-8ff8-4d06-9bee-7b641ff3adde tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:09.523579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad0effef-8ff8-4d06-9bee-7b641ff3adde tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:09.524668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad0effef-8ff8-4d06-9bee-7b641ff3adde tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:09.528852 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad0effef-8ff8-4d06-9bee-7b641ff3adde tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:09.530480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad0effef-8ff8-4d06-9bee-7b641ff3adde tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:09.569544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ad0effef-8ff8-4d06-9bee-7b641ff3adde tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/ips" status: 200 len: 150 microversion: 2.1 time: 0.073287 Mar 08 19:49:09.581086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 111/216] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:49:09 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:09.853517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:09.854182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:09.863307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:09.863757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:09.871746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:09.872208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:10.148890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fa1ff08f-c540-4598-b560-eb1ea9a1d59e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a54ddba1-5863-4866-8ff5-1ec0eeb16996"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:10.150087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fa1ff08f-c540-4598-b560-eb1ea9a1d59e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:10.170862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa1ff08f-c540-4598-b560-eb1ea9a1d59e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:10.171218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa1ff08f-c540-4598-b560-eb1ea9a1d59e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:10.171991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa1ff08f-c540-4598-b560-eb1ea9a1d59e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:10.172437 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa1ff08f-c540-4598-b560-eb1ea9a1d59e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:10.421381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:10.443472 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-abf9ea23-de9c-4b7f-b64b-b4e7b0828e50 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.591170 Mar 08 19:49:10.445063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 106/217] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:09 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:10.598521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fa1ff08f-c540-4598-b560-eb1ea9a1d59e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462370 Mar 08 19:49:10.603936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 112/218] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:49:10 2022] POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:11.237326 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f1ddaf97-0af3-4670-8612-01356503f6c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63d0a72a-6765-422e-bf8b-f7750618fec4"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:11.238792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f1ddaf97-0af3-4670-8612-01356503f6c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:11.251892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1ddaf97-0af3-4670-8612-01356503f6c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:11.252378 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1ddaf97-0af3-4670-8612-01356503f6c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:11.253618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1ddaf97-0af3-4670-8612-01356503f6c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:11.254345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1ddaf97-0af3-4670-8612-01356503f6c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:11.639058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f1ddaf97-0af3-4670-8612-01356503f6c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406388 Mar 08 19:49:11.641028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 113/219] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:49:11 2022] POST /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:11.643647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e27a891d-7905-4cfa-bb98-01311dd5066d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Action: 'create', calling method: .version_select at 0x7f0705a53550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1334473538"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:11.647988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:11.649086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:11.658437 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:11.659082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:11.660018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:11.660632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:11.704930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-e27a891d-7905-4cfa-bb98-01311dd5066d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Getting quotas for project 2b47b5204f2f43e5a2162e5e0f450500. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:49:11.711465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-e27a891d-7905-4cfa-bb98-01311dd5066d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Getting quotas for user eb0a8deca7d04add938354e5a1c1c088 and project 2b47b5204f2f43e5a2162e5e0f450500. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:49:11.862648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:11.872544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-16ac0ae5-c7ec-4bdb-bae1-e5e5b4963823 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.228823 Mar 08 19:49:11.873127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 114/220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:11 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:11.928309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-e27a891d-7905-4cfa-bb98-01311dd5066d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Getting quotas for project 2b47b5204f2f43e5a2162e5e0f450500. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:49:11.932831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-e27a891d-7905-4cfa-bb98-01311dd5066d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Getting quotas for user eb0a8deca7d04add938354e5a1c1c088 and project 2b47b5204f2f43e5a2162e5e0f450500. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:49:11.951964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e27a891d-7905-4cfa-bb98-01311dd5066d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.874676 Mar 08 19:49:11.953477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 107/221] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 19:49:11 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:12.892206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:12.892966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:12.905401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:12.905401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:12.905401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:12.905401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:13.280612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:13.296777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-506d3cce-82b3-4dab-9a33-5a3cfbf6c946 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.402669 Mar 08 19:49:13.297470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 115/222] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:12 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:13.869418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-77a6c974-9667-440b-9a59-19a54d9f4800 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:13.869418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-77a6c974-9667-440b-9a59-19a54d9f4800 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:13.876072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77a6c974-9667-440b-9a59-19a54d9f4800 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:13.879796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77a6c974-9667-440b-9a59-19a54d9f4800 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:13.881372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77a6c974-9667-440b-9a59-19a54d9f4800 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:13.884017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77a6c974-9667-440b-9a59-19a54d9f4800 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:13.920632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-77a6c974-9667-440b-9a59-19a54d9f4800 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/ips" status: 200 len: 151 microversion: 2.20 time: 0.058599 Mar 08 19:49:13.926689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 108/223] 10.222.0.45 () {60 vars in 1288 bytes} [Tue Mar 8 19:49:13 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/ips => generated 151 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:49:14.314297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:14.314959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:14.330403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:14.332797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:14.333656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:14.334108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:14.549545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:14.560244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cc50343c-15ef-4315-a98e-fea71d822bbc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.249377 Mar 08 19:49:14.562349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 116/224] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:14 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:15.579273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:15.579878 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:15.596851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:15.597451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:15.598622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:15.599350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:15.783390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:15.791309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f373bf05-b7cb-4d76-83aa-e941fae046c5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.215783 Mar 08 19:49:15.792244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 109/225] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:15 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:16.444453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:16.445078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:16.452007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:16.452646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:16.453421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:16.453857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:16.475551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lazy-loading 'flavor' on Instance uuid 7fb7515f-c5d4-4330-a70a-c1835a5556c4 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:49:16.806569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b70171ad-30d3-4405-a48c-51068df5f7c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/action" status: 202 len: 0 microversion: 2.20 time: 0.365989 Mar 08 19:49:16.807307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 117/226] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Mar 8 19:49:16 2022] POST /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:49:16.808507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:16.809115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:16.814870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:16.815320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:16.816104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:16.816719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:16.817005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:16.817757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:16.824190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:16.824729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:16.825562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:16.826066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:16.967818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:16.968975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:16.975350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e16be3dc-6d2d-4c6e-8f33-c5b353ed7197 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.170890 Mar 08 19:49:16.976140 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 110/227] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:16 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:16.978391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:16.979888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:16.981128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-04fab1e2-65c9-446f-b746-130189441078 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.168488 Mar 08 19:49:16.982358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 118/228] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:16 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:17.993077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:17.993695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:17.999971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:18.000455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:18.000786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:18.001216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:18.001382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:18.001652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:18.007579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:18.008009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:18.008782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:18.009208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:18.143247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:18.150546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9ab7d126-a5b4-4606-8c0b-4bdc5b0c4f20 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.161346 Mar 08 19:49:18.151149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 111/229] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:17 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:18.166660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:18.174938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:18.176815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:18.178010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b49326cd-d220-4968-bea9-4a787f01db27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.180916 Mar 08 19:49:18.178617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 119/230] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:17 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:49:19.169808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:19.170452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:19.176127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:19.176699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:19.177509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:19.177947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:19.198528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:19.200249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:19.207646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:19.208466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:19.209352 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:19.209858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:19.333390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:19.340972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f6c22f71-b3ff-4272-b0bc-47704c3e56b3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.176000 Mar 08 19:49:19.341547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 112/231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:19 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:19.397606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:19.408236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:19.410417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:19.411955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2fef70da-1f5e-4ea1-91dc-d9d277061747 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.217685 Mar 08 19:49:19.412887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 120/232] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:19 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:19.891522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0bac8a0f-7f19-45b3-91b0-27a592c30fc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:19.897676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0bac8a0f-7f19-45b3-91b0-27a592c30fc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:19.898321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0bac8a0f-7f19-45b3-91b0-27a592c30fc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:19.957791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0bac8a0f-7f19-45b3-91b0-27a592c30fc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Going to try to stop instance {{(pid=123381) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 19:49:19.998396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0bac8a0f-7f19-45b3-91b0-27a592c30fc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action" status: 202 len: 0 microversion: 2.1 time: 0.110544 Mar 08 19:49:19.998924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 113/233] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:49:19 2022] POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:49:20.007233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:20.007814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:20.014311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:20.014773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:20.015538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:20.015976 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:20.148760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:20.157239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b5f0958a-5a96-4851-9fce-baafbcc7db7f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.153767 Mar 08 19:49:20.157825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 121/234] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:20 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:20.358656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:20.359344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:20.365463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:20.365910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:20.366665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:20.367097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:20.435719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:20.435719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:20.439133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:20.440413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:20.440413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:20.440798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:20.513535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:20.521282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-739ee401-76c1-4a26-921a-96365618d055 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.166705 Mar 08 19:49:20.522088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 114/235] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:20 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:20.577363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:20.585124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:20.586636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:20.587852 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1c3e84e3-9c3f-4673-aeaf-39d87443f08a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.160729 Mar 08 19:49:20.588754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 122/236] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:20 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:49:21.175446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:21.176045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:21.182075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:21.182642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:21.183945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:21.184492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:21.380183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:21.391294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6ecb0be0-7b0d-42a0-8374-65b4912f4d81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.219590 Mar 08 19:49:21.391891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 115/237] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:21 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:21.538735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:21.539329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:21.546351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:21.546890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:21.547655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:21.548086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:21.606597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:21.607576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:21.615560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:21.616771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:21.617494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:21.617937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:21.693727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:21.702510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b8b49e33-d756-4891-bac0-b1aa94d91632 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.167815 Mar 08 19:49:21.703359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 123/238] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:21 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:21.768449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:21.776282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:21.778436 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:21.779774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bd6760c3-44d7-4806-9f2c-b0866335f373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.177308 Mar 08 19:49:21.780353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 116/239] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:21 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:22.407521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:22.408129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:22.424998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:22.426888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:22.427879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:22.428521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:22.576750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:22.590904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b6cdcbef-aed5-44a9-8e49-70f83a12ce71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.186809 Mar 08 19:49:22.591968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 124/240] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:22 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:22.720220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:22.721652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:22.729214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:22.729881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:22.732096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:22.732717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:22.798637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:22.799308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:22.805440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:22.805897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:22.806694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:22.807201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:22.916535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:22.924902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d48b1666-4613-4af7-a16d-5dec32169f65 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.208983 Mar 08 19:49:22.925480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 117/241] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:22 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:22.994232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:23.003434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:23.005237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:23.006386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6060ba8a-3ec8-4e8d-bc5b-0e86fc0e0426 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.211693 Mar 08 19:49:23.007011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 125/242] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:22 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:23.608758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:23.609392 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:23.616425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:23.616885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:23.617672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:23.618257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:23.757081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:23.765099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4c4f031f-4dc9-4523-b610-a1f54752d19e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.161617 Mar 08 19:49:23.765668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 118/243] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:23 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:23.942586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:23.943238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:23.949672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:23.950126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:23.951127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:23.951369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:24.025194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:24.025805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:24.032247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:24.032940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:24.033720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:24.034155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:24.100807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:24.116591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e5ba8734-8098-4a4c-851b-fb65402430aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.175767 Mar 08 19:49:24.117374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 126/244] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:23 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:24.187095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:24.195207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:24.197336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:24.198472 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4602ebda-5915-4ea8-b180-79bc2e7d3bcd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.177277 Mar 08 19:49:24.199626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 119/245] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:24 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:24.781728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:24.782337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:24.788544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:24.789004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:24.790413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:24.790849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:24.946999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:24.955530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-770e5c00-7700-4c62-9603-e4cac5fabf31 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.177914 Mar 08 19:49:24.956261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 127/246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:24 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:25.134384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:25.135440 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:25.142352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:25.142865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:25.144012 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:25.145661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:25.219126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:25.219875 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:25.226673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:25.227328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:25.228495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:25.229181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:25.313921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:25.328721 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-53c878f8-599e-460b-98b2-920201c812c7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.198403 Mar 08 19:49:25.329292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 120/247] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:25 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:25.374987 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:25.383257 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:25.384797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:25.386062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-65b64fab-f792-4834-8222-591d27cbbd5a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.172306 Mar 08 19:49:25.387175 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 128/248] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:25 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:25.810850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1528a51b-d85e-4edb-b162-6c9924778e4e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: .version_select at 0x7f07051bd5e0>, body: {"keypair": {"name": "tempest-keypair-1242998532"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:25.827888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-1528a51b-d85e-4edb-b162-6c9924778e4e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:49:25.837513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-1528a51b-d85e-4edb-b162-6c9924778e4e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:49:25.975366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:25.976434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:25.983619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:25.984085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:25.984880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:25.985315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:26.040745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-1528a51b-d85e-4edb-b162-6c9924778e4e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:49:26.044936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-1528a51b-d85e-4edb-b162-6c9924778e4e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:49:26.058705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1528a51b-d85e-4edb-b162-6c9924778e4e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.252346 Mar 08 19:49:26.059312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 121/249] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 19:49:25 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:26.133922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:26.146263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4e5c5dca-594f-4429-b710-cc90bb34b92d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.174483 Mar 08 19:49:26.148916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 129/250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:25 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:26.346941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:26.348444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:26.354623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:26.355914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:26.356737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:26.357268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:26.405021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:26.406034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:26.413712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:26.414410 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:26.417077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:26.418275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:26.569702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:26.579046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bdd16096-40b1-4623-bc5a-4fa68b05979d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.236499 Mar 08 19:49:26.590110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 122/251] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:26 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:26.614094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:26.623243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:26.625077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:26.626279 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a8897a14-d68f-4e14-93db-37d9355d3adc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.225651 Mar 08 19:49:26.626814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 130/252] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:26 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:27.163092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:27.164116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:27.175710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:27.180601 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:27.182043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:27.184754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:27.418549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:27.426125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-59678f6c-74db-4ebf-9baa-37c6fd857ac3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.267791 Mar 08 19:49:27.426700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 123/253] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:27 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:27.597882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:27.598441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:27.604637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:27.605593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:27.606632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:27.606760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:27.616568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1889757546", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dfea349b-6bfd-41c2-92c4-062cebf33ab6"}], "security_groups": [{"name": "tempest-securitygroup--560972698"}], "key_name": "tempest-keypair-1242998532", "user_data": "}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:27.740688 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] validate_networks() for [('dfea349b-6bfd-41c2-92c4-062cebf33ab6', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:49:27.766224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:27.774905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-32b1a05a-d114-4c29-a519-42707032bcb3 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.180358 Mar 08 19:49:27.775481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 131/254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:27 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:27.780302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:27.781072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:27.788101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:27.789689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:27.790498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:27.790931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:27.929835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:27.938306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:27.939738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:27.940856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-49e721db-4c81-41be-ac8a-706ec57cd75e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.164303 Mar 08 19:49:27.941416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 132/255] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:27 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:28.176110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:49:28.176558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:49:28.177203 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:49:28.177642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:49:28.178151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:49:28.187520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.187971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:28.188810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.189249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:28.206323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:49:28.210307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:49:28.226857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:49:28.229173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:49:28.275782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a41ca401-37dc-4e8d-860a-b9e98e931bf0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663338 Mar 08 19:49:28.276946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 124/256] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:49:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 19:49:28.286295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3c53c73d-e9c3-42b8-96d6-2a3caf6f28fe tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:28.287117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3c53c73d-e9c3-42b8-96d6-2a3caf6f28fe tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:28.370054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3c53c73d-e9c3-42b8-96d6-2a3caf6f28fe tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:28.385217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3c53c73d-e9c3-42b8-96d6-2a3caf6f28fe tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1242 microversion: 2.1 time: 0.102703 Mar 08 19:49:28.386253 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 133/257] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:28 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:28.445768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:28.446552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:28.454611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.455965 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:28.456976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.457429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:28.626208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:28.635538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-683dd4bb-094b-402d-a07a-e1ef978d62e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.195487 Mar 08 19:49:28.636752 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 125/258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:28 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:28.791075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:28.791981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:28.799186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.799674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:28.800692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.801130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:28.939087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:28.947128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6ad6956e-cd8d-4bf8-b67e-d7e962ea0f86 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.160048 Mar 08 19:49:28.947740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 134/259] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:28 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:28.962149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:28.962751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:28.969902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.970488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:28.971430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:28.971872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:29.111248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:29.119204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:29.120758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:29.121884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c3e752d3-ad69-4c26-b02e-ace3b0c61073 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.163760 Mar 08 19:49:29.122434 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 126/260] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:28 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:29.403420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:29.403989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:29.409869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:29.410315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:29.411073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:29.411502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:29.471911 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:29.480514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2bfc17bc-9eb8-4c30-a9ff-6ae14377f2ff tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1294 microversion: 2.1 time: 0.080893 Mar 08 19:49:29.481091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 135/261] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:29 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1294 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:29.655616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:29.656176 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:29.664917 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:29.665940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:29.667434 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:29.670342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:29.934382 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:29.942691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7ba1f725-5a42-46ff-9997-cc4521bd2a37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.291161 Mar 08 19:49:29.943259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 127/262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:29 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:29.964793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:29.966012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:29.973200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:29.973905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:29.974802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:29.975390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.138910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:30.139746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:30.166982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.167981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.168821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.172216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.212844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:30.223044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cc78580b-52e2-4644-9a4a-19fb1db51abe tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1503 microversion: 2.1 time: 0.261949 Mar 08 19:49:30.224356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 136/263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:29 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:30.241063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a998f653-016d-419e-9df8-4d9bd25f4a2a"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:30.242447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:30.249751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.251027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.252015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.252998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.282969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] HTTP exception thrown: Cannot 'attach_volume' instance aae2ebb6-0a33-4828-9401-549caf63b885 while it is in vm_state rescued Mar 08 19:49:30.283968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Returning 409 to user: Cannot 'attach_volume' instance aae2ebb6-0a33-4828-9401-549caf63b885 while it is in vm_state rescued {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:49:30.285473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-10e05f3b-e79b-411f-b0c0-9a10ee80da21 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048132 Mar 08 19:49:30.290140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 137/264] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:49:30 2022] POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 08 19:49:30.296363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3c729c09-51a2-426d-993b-88a4d9958811 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:30.297412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3c729c09-51a2-426d-993b-88a4d9958811 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:30.304363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c729c09-51a2-426d-993b-88a4d9958811 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.305316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c729c09-51a2-426d-993b-88a4d9958811 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.306438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c729c09-51a2-426d-993b-88a4d9958811 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.307285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c729c09-51a2-426d-993b-88a4d9958811 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.390389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:30.404123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:30.408329 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:30.410994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c75241a8-0205-4665-b048-03299938e239 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.275885 Mar 08 19:49:30.411595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 128/265] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:30 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:30.428184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3c729c09-51a2-426d-993b-88a4d9958811 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action" status: 202 len: 0 microversion: 2.1 time: 0.136408 Mar 08 19:49:30.429310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 138/266] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:49:30 2022] POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:49:30.454331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:30.456501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:30.465488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.466380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.468320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.469272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.512526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:30.520572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:30.540329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.540793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.541768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.542550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.756669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:30.764273 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-99955f76-6c47-4ad1-8936-b8fc89374759 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.270218 Mar 08 19:49:30.764874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 139/267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:30 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:30.823229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:30.831621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f84bf5e9-e867-45c7-bc50-210c325eba98 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1511 microversion: 2.1 time: 0.394507 Mar 08 19:49:30.832196 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 129/268] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:30 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:30.959409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:30.960021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:30.966147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.966756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:30.967464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:30.967906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:31.199684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:31.209570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9b2d896e-0c80-4d0e-b96c-6a05ff6f7eca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.253119 Mar 08 19:49:31.210874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 140/269] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:30 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:31.430000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:31.431768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:31.439947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:31.440675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:31.441821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:31.442475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:31.781952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:31.782844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:31.788979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:31.790257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:31.790386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:31.791175 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:31.791810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:31.802414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:31.806569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:31.808037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6a6c1b17-bd88-40d5-b396-0e00d90f972d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.381954 Mar 08 19:49:31.808734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 130/270] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:31 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:31.848711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:31.849398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:31.858862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:31.859320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:31.871336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:31.871941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:32.083673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:32.092935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-478cc87f-bf50-4737-8161-efe2edf01c6e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.314584 Mar 08 19:49:32.113362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 141/271] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:31 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:32.226920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:32.227560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:32.233501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:32.233983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:32.234775 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:32.235210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:32.280150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:32.288352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-177f3397-bf1d-473d-8031-a31553d3e81b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1511 microversion: 2.1 time: 0.443194 Mar 08 19:49:32.298595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 131/272] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:31 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:32.387252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-58e52172-ebb0-44cb-b7d7-227c71542968 req-dbebcb73-6a99-41b8-ab3b-2223cee15651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7092a06-ffd5-4d33-883b-eee953ed48fd", "tag": "94b67e3f-c2ae-40cf-b44c-507ba8c0d290"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:32.398151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:32.410272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fe842aa9-6d5f-4a2a-b5dd-780e26335187 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.187173 Mar 08 19:49:32.413510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 142/273] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:32 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:32.436644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-58e52172-ebb0-44cb-b7d7-227c71542968 req-dbebcb73-6a99-41b8-ab3b-2223cee15651 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:32.438585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-58e52172-ebb0-44cb-b7d7-227c71542968 req-dbebcb73-6a99-41b8-ab3b-2223cee15651 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:32.456125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-58e52172-ebb0-44cb-b7d7-227c71542968 req-dbebcb73-6a99-41b8-ab3b-2223cee15651 service nova] Creating event network-changed:94b67e3f-c2ae-40cf-b44c-507ba8c0d290 for instance b7092a06-ffd5-4d33-883b-eee953ed48fd on hv-cinder-83009 Mar 08 19:49:32.463347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-58e52172-ebb0-44cb-b7d7-227c71542968 req-dbebcb73-6a99-41b8-ab3b-2223cee15651 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082116 Mar 08 19:49:32.463960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 132/274] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:49:32.828213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:32.828866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:32.835032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:32.835809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:32.836832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:32.837478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:33.024756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:33.034284 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:33.035839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:33.037030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fd9d4baf-4b25-43f2-949e-297a69617944 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.213547 Mar 08 19:49:33.037629 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 143/275] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:32 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:33.086750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-305589435", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1334473538", "security_groups": [{"name": "tempest-secgroup-smoke-1402729954"}], "networks": [{"uuid": "15c07b37-2e57-425d-a12f-c3c92656e6be"}], "block_device_mapping_v2": [{"uuid": "f9f2959e-8b06-4c4b-9060-122b0e26198e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:33.122354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:33.123516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:33.134694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:33.135446 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:33.136993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:33.137614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:33.285683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:33.293683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c411f432-3bc5-4e32-8378-1e33e3dc7b98 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.188244 Mar 08 19:49:33.294241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 144/276] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:33 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:33.305841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:33.306516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:33.313428 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:33.313951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:33.317532 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:33.318069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:33.344716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] validate_networks() for [('15c07b37-2e57-425d-a12f-c3c92656e6be', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:49:33.484624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:33.494807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3799f3a6-a4b1-43b6-9b34-b00e0b8b6013 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1511 microversion: 2.1 time: 0.192669 Mar 08 19:49:33.505948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 145/277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:33 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:33.516611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:33.517589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:33.524769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:33.525380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:33.526351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:33.527048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:33.757023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:33.768101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0b82876b-1961-4e5b-8fe1-fad2729d4d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.260539 Mar 08 19:49:33.768744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 146/278] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:33 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:33.989291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:49:33.990008 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:49:33.990553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:49:33.991037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:49:33.991504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:49:34.001777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.002588 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.003727 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.004875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.028346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Getting quotas for project 2b47b5204f2f43e5a2162e5e0f450500. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:49:34.033910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Getting quotas for user eb0a8deca7d04add938354e5a1c1c088 and project 2b47b5204f2f43e5a2162e5e0f450500. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:49:34.054816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:34.055465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:34.066503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.066503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.066503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.066503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.119931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:49:34.122880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9f2959e-8b06-4c4b-9060-122b0e26198e',volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:49:34.231586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:34.239907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:34.241451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:34.242932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2fddf338-d7a0-4a01-ae21-d36d7f9920f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1744 microversion: 2.20 time: 0.191990 Mar 08 19:49:34.256752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 147/279] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:34 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:49:34.287388 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a8a2bc79-9166-43bf-a517-4940cac0fe81 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.205117 Mar 08 19:49:34.288029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 133/280] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:49:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:49:34.299539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0bb1bcb6-d82a-474f-aa2d-458cbac0c9f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:34.300309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0bb1bcb6-d82a-474f-aa2d-458cbac0c9f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:34.319090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:34.319888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:34.328076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.328748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.329548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.329989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.368701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0bb1bcb6-d82a-474f-aa2d-458cbac0c9f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:34.376480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0bb1bcb6-d82a-474f-aa2d-458cbac0c9f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1088 microversion: 2.1 time: 0.080724 Mar 08 19:49:34.377300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 148/281] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:34.504624 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:34.512988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d5291512-794a-4692-9ab6-7ef46688452a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.199197 Mar 08 19:49:34.513554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 134/282] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:34 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:34.515247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:34.516020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:34.526875 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.527562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.529263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.530081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.685203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:34.695023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d92541e8-edb3-459c-a752-159a2dcb89a7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1517 microversion: 2.1 time: 0.183623 Mar 08 19:49:34.695756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 149/283] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:34 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:34.792318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:34.792974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:34.806741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.807202 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.810868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:34.811528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:34.998785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:35.007692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e1b8d8a6-bf7d-40fb-8892-fa6406258f11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1725 microversion: 2.1 time: 0.225277 Mar 08 19:49:35.008655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 135/284] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:34 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:35.264501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:35.265223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:35.272927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:35.273297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:35.274394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:35.274508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:35.394606 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:35.395216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:35.410398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:35.415140 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:35.417322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:35.421768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:35.482640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:35.493356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:35.496443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:35.509152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-db9de11a-3cf4-4409-9e75-1044cf816708 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1744 microversion: 2.20 time: 0.249189 Mar 08 19:49:35.520611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:35.531336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-35af9150-9757-4113-a4b6-30a1c2c65a0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1186 microversion: 2.1 time: 0.139158 Mar 08 19:49:35.531507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 136/285] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1186 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:35.542068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 150/286] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:35 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1744 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:35.548616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:35.549247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:35.563008 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:35.563466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:35.564252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:35.564717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:35.898082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:35.904081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2f883597-594b-4927-9007-0e34f75dba6d tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.371340 Mar 08 19:49:35.904692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 137/287] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:35 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:36.027359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:36.028144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:36.034774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.035248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.036718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.037281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.186385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:36.186990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:36.187099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:36.193037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.193485 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.194259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.194691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.194870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-51ec27b6-9b7f-4ae7-b480-75a6f55eaf8c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1702 microversion: 2.1 time: 0.173609 Mar 08 19:49:36.195624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 151/288] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:36 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1702 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:36.211716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-180cb640-993e-4683-b360-3c1123faa7ad tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:36.218500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-180cb640-993e-4683-b360-3c1123faa7ad tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.219039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-180cb640-993e-4683-b360-3c1123faa7ad tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.286153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-180cb640-993e-4683-b360-3c1123faa7ad tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Going to try to start instance {{(pid=123380) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 19:49:36.328684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-180cb640-993e-4683-b360-3c1123faa7ad tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action" status: 202 len: 0 microversion: 2.1 time: 0.120976 Mar 08 19:49:36.329658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 152/289] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:49:36 2022] POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:49:36.338864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:36.339591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:36.348901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.349388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.350172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.350815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.435108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:36.443789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d6845496-4c1c-4b4a-a867-39355101a866 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1517 microversion: 2.1 time: 0.261105 Mar 08 19:49:36.445058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 138/290] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:36 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1517 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:36.468625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-57e5eae7-5a19-439d-a63e-0c0622fdcc19 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55302db9-78f8-48c4-bb3e-e29716973769"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:36.469762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-57e5eae7-5a19-439d-a63e-0c0622fdcc19 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:36.477028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57e5eae7-5a19-439d-a63e-0c0622fdcc19 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.477475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57e5eae7-5a19-439d-a63e-0c0622fdcc19 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.478250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57e5eae7-5a19-439d-a63e-0c0622fdcc19 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.478677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57e5eae7-5a19-439d-a63e-0c0622fdcc19 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.514781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:36.524363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a9aa4578-31f3-438f-85ca-5634eea835fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1711 microversion: 2.1 time: 0.190632 Mar 08 19:49:36.525249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 153/291] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:36 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1711 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:36.537329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:36.537941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:36.546207 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.546658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.547503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.547858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.722611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:36.744604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:36.747747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:36.749329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4a6e5622-fa26-4f5e-965f-d4037e6097f1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1744 microversion: 2.20 time: 0.219611 Mar 08 19:49:36.759894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 154/292] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:36 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:49:36.788660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:36.789855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:36.800615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.801074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.801862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:36.802297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:36.982565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-57e5eae7-5a19-439d-a63e-0c0622fdcc19 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.517592 Mar 08 19:49:36.983976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 139/293] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:49:36 2022] POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:49:37.006555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:37.007584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:37.015839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:37.016719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:37.017743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:37.018444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:37.131741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:37.142738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1be714a9-770d-4329-bb0e-7a70284c2c3a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1272 microversion: 2.1 time: 0.374931 Mar 08 19:49:37.143550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 155/294] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:37.160467 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-868879fb-eb41-4e0f-abb3-c90d02dc8201 req-a0f534af-8213-4ab6-a1de-c081f60dfcff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb7515f-c5d4-4330-a70a-c1835a5556c4", "name": "network-vif-plugged", "status": "completed", "tag": "38ecd555-5c0f-44c2-850e-97cbfeea62d4"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:37.190564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-868879fb-eb41-4e0f-abb3-c90d02dc8201 req-a0f534af-8213-4ab6-a1de-c081f60dfcff service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:37.190943 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-868879fb-eb41-4e0f-abb3-c90d02dc8201 req-a0f534af-8213-4ab6-a1de-c081f60dfcff service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:37.214545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-868879fb-eb41-4e0f-abb3-c90d02dc8201 req-a0f534af-8213-4ab6-a1de-c081f60dfcff service nova] Creating event network-vif-plugged:38ecd555-5c0f-44c2-850e-97cbfeea62d4 for instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 on hv-cinder-83009 Mar 08 19:49:37.227349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-868879fb-eb41-4e0f-abb3-c90d02dc8201 req-a0f534af-8213-4ab6-a1de-c081f60dfcff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075806 Mar 08 19:49:37.228406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 156/295] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:37.543482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:37.544186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:37.553435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:37.553799 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:37.554750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:37.555403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:37.742525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:37.752340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-17dd3013-fc4a-4551-a190-8de612d2a7e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1711 microversion: 2.1 time: 0.213629 Mar 08 19:49:37.752891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 157/296] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:37 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1711 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:37.767347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:37.768214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:37.775117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:37.775781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:37.777308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:37.777905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:37.803089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:37.810466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-329894f3-0e5e-4baf-a072-6d3d61388bda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.820407 Mar 08 19:49:37.820833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 140/297] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:36 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:37.937055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:37.947159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:37.949535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:37.951897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-61abb6af-d48a-48b6-afb8-26e75904d53e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.188522 Mar 08 19:49:37.964123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 158/298] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:37 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:38.167839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:38.168501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:38.184935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.188657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.189916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.190974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.487243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:38.497576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-097c66e8-6700-4b96-88aa-08bf929593f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.339105 Mar 08 19:49:38.498540 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 141/299] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:38.571464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-3abb7cf4-2638-45ba-b0f4-d6365d7b8327 req-2a047282-0ab3-4e0b-9c42-9418b9ac3ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ec178e-8ba4-4606-8aa8-131038fc027e", "tag": "bf60bdec-d657-4193-8d4c-6d75b8d18de9"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:38.590088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-3abb7cf4-2638-45ba-b0f4-d6365d7b8327 req-2a047282-0ab3-4e0b-9c42-9418b9ac3ff4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.590553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-3abb7cf4-2638-45ba-b0f4-d6365d7b8327 req-2a047282-0ab3-4e0b-9c42-9418b9ac3ff4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.607722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-3abb7cf4-2638-45ba-b0f4-d6365d7b8327 req-2a047282-0ab3-4e0b-9c42-9418b9ac3ff4 service nova] Creating event network-changed:bf60bdec-d657-4193-8d4c-6d75b8d18de9 for instance 08ec178e-8ba4-4606-8aa8-131038fc027e on hv-cinder-83009 Mar 08 19:49:38.615135 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-3abb7cf4-2638-45ba-b0f4-d6365d7b8327 req-2a047282-0ab3-4e0b-9c42-9418b9ac3ff4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047652 Mar 08 19:49:38.618761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 159/300] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:38.771233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:38.772136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:38.779463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.779914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.781117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.781229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.838640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:38.839889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:38.849323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.850277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.851214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.851803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.947684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:38.969354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4f1f7b53-3141-41d2-aa1e-18d8b290bbda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1711 microversion: 2.1 time: 0.203675 Mar 08 19:49:38.970321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 142/301] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:38 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1711 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:38.975430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:38.976079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:38.985996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.986446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:38.987227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:38.987661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:39.067648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:39.079499 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0365a8b9-ba59-448f-aab1-30feb7c5bb3a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.245028 Mar 08 19:49:39.090103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 160/302] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:38 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:39.147117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:39.156087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:39.157620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:39.158964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f05a6720-8a1b-4dce-804d-5334210558ae tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.187290 Mar 08 19:49:39.159730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 143/303] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:38 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:39.514947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:39.515522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:39.533711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:39.535414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:39.536420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:39.544112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:39.740261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:39.750273 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6019cd3a-bdfa-440a-88c4-aa6e994b3289 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.239147 Mar 08 19:49:39.760053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 161/304] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:39 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:39.986587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:39.987170 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:39.993482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:39.993927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:39.994906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:39.995856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:40.099781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:40.101336 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:40.108516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:40.109224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:40.110168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:40.111456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:40.154073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:40.163210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5b118146-d6a5-43cc-ada3-37ab62756202 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1711 microversion: 2.1 time: 0.180509 Mar 08 19:49:40.174087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 144/305] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:39 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1711 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:40.179408 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:40.189741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:40.196432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:40.197127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:40.198089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:40.198739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:40.306093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:40.319111 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a1d3ba2e-1083-4514-b77e-1b09f6e2d87a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.226300 Mar 08 19:49:40.320039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 162/306] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:40 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:40.419471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:40.441152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:40.442800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:40.444231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5668dba7-0b00-40d7-a99a-c9a81655806a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.268977 Mar 08 19:49:40.444992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 145/307] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:40 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:40.580855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-45a994da-e721-45d1-93d8-474fbbde5473 req-cb6b3332-bac1-4fd3-bfc4-44757dc4594f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7092a06-ffd5-4d33-883b-eee953ed48fd", "name": "network-vif-plugged", "status": "completed", "tag": "94b67e3f-c2ae-40cf-b44c-507ba8c0d290"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:40.591490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-45a994da-e721-45d1-93d8-474fbbde5473 req-cb6b3332-bac1-4fd3-bfc4-44757dc4594f service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:40.592393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-45a994da-e721-45d1-93d8-474fbbde5473 req-cb6b3332-bac1-4fd3-bfc4-44757dc4594f service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:40.612179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-45a994da-e721-45d1-93d8-474fbbde5473 req-cb6b3332-bac1-4fd3-bfc4-44757dc4594f service nova] Creating event network-vif-plugged:94b67e3f-c2ae-40cf-b44c-507ba8c0d290 for instance b7092a06-ffd5-4d33-883b-eee953ed48fd on hv-cinder-83009 Mar 08 19:49:40.619084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-45a994da-e721-45d1-93d8-474fbbde5473 req-cb6b3332-bac1-4fd3-bfc4-44757dc4594f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042246 Mar 08 19:49:40.620454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 163/308] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:40.770978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:40.772027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:40.794079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:40.794591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:40.795674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:40.801268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:41.182272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:41.185108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:41.197794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:41.198576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:41.199908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:41.200994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:41.282389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:41.298020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-83760537-f534-4386-87a5-5dc5b3a31cec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.534718 Mar 08 19:49:41.299231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 146/309] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:41.339613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:41.339613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:41.347326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:41.347787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:41.348605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:41.349050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:41.383191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:41.403276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-61e68264-4b61-47d4-91c1-4b14c42a9b11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1711 microversion: 2.1 time: 0.225487 Mar 08 19:49:41.412471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 164/310] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:41 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1711 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:41.463764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:41.464483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:41.470573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:41.471213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:41.472136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:41.472744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:41.558365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:41.568040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2a9bae7b-0eb0-4fec-b1d5-41b8ce2981ea tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.235059 Mar 08 19:49:41.578463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 147/311] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:41 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:41.633979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:41.645040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:41.646969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:41.648243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3e33d18c-be0a-441a-a7db-e152bfd75154 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.188420 Mar 08 19:49:41.660962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 165/312] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:41 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:49:42.314804 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:42.315389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:42.321998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.322443 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.324015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.324613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.420568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:42.421773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:42.433823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.434540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.435321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.435757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.534358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:42.544453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-68ef2ef0-0040-4544-babc-e0adfb0bf080 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.233487 Mar 08 19:49:42.545590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 148/313] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:42.585998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:42.587037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:42.595907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.596681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.597977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.598766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.657382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:42.671136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-da2df395-d6a0-4751-98c3-bd532683f7be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1711 microversion: 2.1 time: 0.251558 Mar 08 19:49:42.671687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 166/314] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:42 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1711 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:42.679989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:42.680858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:42.687018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.687472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.688258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:42.688712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:42.798863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:42.810999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c4a716e8-7b5c-4e47-9a85-82fb1f9a7609 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.229561 Mar 08 19:49:42.824048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 149/315] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:42 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:42.842806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:42.851027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:42.852558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:42.853957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-495d1ec7-433a-4ba4-b4e2-c733f6494420 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.181070 Mar 08 19:49:42.859607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 167/316] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:42 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:43.563077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:43.564777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:43.572582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.573286 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:43.574869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.575463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:43.689301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:43.690265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:43.696763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.697810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:43.699500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.700133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:43.721127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:43.729714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e20a9004-cfc2-4444-8b47-a06f1597e895 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.171684 Mar 08 19:49:43.740253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 150/317] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:43.828681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:43.829281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:43.837226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.838041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:43.839091 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.839681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:43.869016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:43.878753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0518c242-ee70-43cb-b3d3-52ffdfe9cfdb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1711 microversion: 2.1 time: 0.193861 Mar 08 19:49:43.879328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 168/318] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:43 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1711 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:43.884949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:43.885883 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:43.892317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.893015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:43.894238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:43.894829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:44.008132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:44.025049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-46d44c99-49fe-4f73-b85b-387543dea84f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.200051 Mar 08 19:49:44.026841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 151/319] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:43 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:44.074347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:44.087082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:44.087082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:44.087082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1099fb7d-3444-4a79-a344-31ad0af829c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.205997 Mar 08 19:49:44.096424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 169/320] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:43 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:44.747212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:44.747742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:44.754207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:44.754862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:44.755637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:44.756076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:44.895146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:44.896515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:44.905009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:44.906402 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:44.908395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:44.909100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:44.958910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:44.970850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f7b0b374-98d8-47b7-918b-c3b4b6e7f005 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.227685 Mar 08 19:49:44.981439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 152/321] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:44 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:45.044555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:45.045471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:45.051609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:45.052205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:45.053371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:45.053506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:45.102960 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:45.138385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e0ec2279-64db-4cb4-9693-54a213aceca5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1715 microversion: 2.1 time: 0.247248 Mar 08 19:49:45.139527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 170/322] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:44 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1715 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:45.144915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:45.145949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:45.152568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:45.153321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:45.154772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:45.156097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:45.312713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:45.335587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6a6115be-ce0a-4b44-8f2b-36b45e96ed85 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1367 microversion: 2.1 time: 0.295226 Mar 08 19:49:45.345579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 153/323] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:45 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:45.375970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:45.385460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:45.388521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:45.389788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4902b2d2-40ee-4e22-bcc3-6831eef8f58c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.249121 Mar 08 19:49:45.400373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 171/324] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:45 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:45.989162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:45.990411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:45.997899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:45.998567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:45.999532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:45.999988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:46.159598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:46.168387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d4d076f3-5d80-49cd-a8ef-22e7129d54c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.182982 Mar 08 19:49:46.177418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 154/325] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:46.357421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:46.358003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:46.364643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:46.365095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:46.365889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:46.366326 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:46.409550 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:46.410162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:46.429912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:46.429912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:46.429912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:46.429912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:46.524161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:46.534269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-960c832c-91d0-40c2-a36c-69e0e0763fd0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1557 microversion: 2.1 time: 0.181264 Mar 08 19:49:46.535155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 172/326] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:46 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:46.554696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-41c7bea4-5cfa-4abc-ac3e-ccb5e642e75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:46.555304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-41c7bea4-5cfa-4abc-ac3e-ccb5e642e75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:46.562269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41c7bea4-5cfa-4abc-ac3e-ccb5e642e75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:46.562856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41c7bea4-5cfa-4abc-ac3e-ccb5e642e75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:46.564270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41c7bea4-5cfa-4abc-ac3e-ccb5e642e75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:46.564850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41c7bea4-5cfa-4abc-ac3e-ccb5e642e75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:46.581278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:46.590460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:46.592179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:46.593880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-456df81d-6a33-4437-82a6-08f365e13ea8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.188076 Mar 08 19:49:46.595084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 155/327] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:46 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:49:46.660307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-41c7bea4-5cfa-4abc-ac3e-ccb5e642e75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112578 Mar 08 19:49:46.660996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 173/328] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Mar 8 19:49:46 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:47.185153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:47.186531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:47.194236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:47.195032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:47.196230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:47.196799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:47.341586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:47.349324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-605bb78c-dd45-4008-9ab2-796a2cad06c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.168655 Mar 08 19:49:47.349929 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 156/329] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:47.613118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:47.613848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:47.619765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:47.620309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:47.621156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:47.621660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:47.852215 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:47.861213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:47.862713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:47.872481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-751a1e90-9a11-4997-b5f6-12d0316a1baf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.255218 Mar 08 19:49:47.873113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 174/330] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:47 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:47.953520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-60880345-a33e-424f-b500-7d364c06f4bc req-123216f2-2c7c-4c88-a126-f71c49a869ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7092a06-ffd5-4d33-883b-eee953ed48fd", "tag": "94b67e3f-c2ae-40cf-b44c-507ba8c0d290"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:47.961572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-60880345-a33e-424f-b500-7d364c06f4bc req-123216f2-2c7c-4c88-a126-f71c49a869ce service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:47.962016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-60880345-a33e-424f-b500-7d364c06f4bc req-123216f2-2c7c-4c88-a126-f71c49a869ce service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:47.972560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-60880345-a33e-424f-b500-7d364c06f4bc req-123216f2-2c7c-4c88-a126-f71c49a869ce service nova] Creating event network-changed:94b67e3f-c2ae-40cf-b44c-507ba8c0d290 for instance b7092a06-ffd5-4d33-883b-eee953ed48fd on hv-cinder-83009 Mar 08 19:49:47.977683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-60880345-a33e-424f-b500-7d364c06f4bc req-123216f2-2c7c-4c88-a126-f71c49a869ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027766 Mar 08 19:49:47.978268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 157/331] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:49:48.366520 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:48.367182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:48.374814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:48.375351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:48.376241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:48.376779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:48.506925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:48.515350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cb29837a-d5a5-411a-93e0-20f2ca1709c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.152756 Mar 08 19:49:48.515918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 175/332] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:48.892174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:48.892820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:48.902433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:48.902878 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:48.903644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:48.904231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:49.136051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:49.143862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:49.145428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:49.146564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eb8a8bcd-7113-4b73-b484-3546235410ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.259414 Mar 08 19:49:49.147124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 158/333] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:48 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:49.532599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:49.533208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:49.539725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:49.540176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:49.540971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:49.541409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:49.684526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:49.692211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8129c405-e831-45af-bb30-3e7da3b41049 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.163589 Mar 08 19:49:49.692966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 176/334] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:50.165264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:50.165893 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:50.173527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:50.173980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:50.174780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:50.175214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:50.373884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:50.381666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:50.383160 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:50.384307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b3089ac9-e92b-439a-a3b8-7a72d5de7373 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1739 microversion: 2.20 time: 0.223332 Mar 08 19:49:50.384876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 159/335] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:50 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:50.708711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:50.709310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:50.715723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:50.716170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:50.717189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:50.717622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:50.846289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:50.853441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-844f0acb-a69d-4ed1-b54c-aac7d38e7e50 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.148537 Mar 08 19:49:50.853999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 177/336] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:50 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:51.402943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:51.403546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:51.409891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:51.410337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:51.411094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:51.411526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:51.537937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:51.546249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:51.547748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:51.548903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b07c0ad5-87aa-4d51-8cd3-ff50cdba5d3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1721 microversion: 2.20 time: 0.149873 Mar 08 19:49:51.549456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 160/337] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:51 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:51.869923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:51.870531 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:51.876811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:51.877264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:51.878033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:51.878467 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:52.015890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:52.023343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7f87cd76-dcde-4f3e-80d1-c31ac20c5d83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.157265 Mar 08 19:49:52.023902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 178/338] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:51 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:52.568769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:52.569661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:52.578238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:52.578927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:52.579742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:52.580326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:52.771342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:52.781535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:52.783056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:52.784210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b577590e-fed9-43ef-8af3-348de2a8ca55 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1721 microversion: 2.20 time: 0.219908 Mar 08 19:49:52.784789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 161/339] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:52 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:53.040625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:53.041198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:53.047817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.048269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:53.049132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.049570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:53.194781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:53.202053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-77d48773-1e57-4604-bd97-4c900df5e266 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.165674 Mar 08 19:49:53.202819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 179/340] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:53 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:53.235840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:53.236851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:53.242839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.243295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:53.244070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.244536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:53.266219 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lazy-loading 'flavor' on Instance uuid aae2ebb6-0a33-4828-9401-549caf63b885 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:49:53.409857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7c6c0534-4781-4df2-90ad-60c1e6b8831b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action" status: 200 len: 32 microversion: 2.1 time: 0.177752 Mar 08 19:49:53.410596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 162/341] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:49:53 2022] POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:49:53.423656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:53.424264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:53.442011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.442131 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:53.442975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.444011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:53.597890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:53.623485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e852b7cf-fdb3-42a3-8ff5-486e23c46a8a tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.206832 Mar 08 19:49:53.624678 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 180/342] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:53 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:53.803599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:53.804315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:53.810151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.810757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:53.811525 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:53.811951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:54.019778 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:54.028060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:54.029609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:54.030744 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fa15eb88-e9e4-49d3-bfce-11c1d63e3788 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1721 microversion: 2.20 time: 0.231899 Mar 08 19:49:54.031299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 163/343] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:53 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:54.218243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:54.218847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:54.224999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:54.225443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:54.226221 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:54.226653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:54.355262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:54.362713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d429ffcd-8013-428e-be10-04b09739fd7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.148258 Mar 08 19:49:54.363270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 181/344] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:54 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:54.574063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-f13e529c-65b9-4a60-b57e-694c394e6792 req-d13b0fdc-6f64-44fc-aa1f-f497d2e414ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb7515f-c5d4-4330-a70a-c1835a5556c4", "name": "network-vif-unplugged", "status": "completed", "tag": "38ecd555-5c0f-44c2-850e-97cbfeea62d4"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:54.582300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-f13e529c-65b9-4a60-b57e-694c394e6792 req-d13b0fdc-6f64-44fc-aa1f-f497d2e414ea service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:54.582747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-f13e529c-65b9-4a60-b57e-694c394e6792 req-d13b0fdc-6f64-44fc-aa1f-f497d2e414ea service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:54.593925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-f13e529c-65b9-4a60-b57e-694c394e6792 req-d13b0fdc-6f64-44fc-aa1f-f497d2e414ea service nova] Creating event network-vif-unplugged:38ecd555-5c0f-44c2-850e-97cbfeea62d4 for instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 on hv-cinder-83009 Mar 08 19:49:54.598590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-f13e529c-65b9-4a60-b57e-694c394e6792 req-d13b0fdc-6f64-44fc-aa1f-f497d2e414ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028848 Mar 08 19:49:54.599179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 164/345] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:49:54.641501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:54.642104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:54.647833 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:54.648276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:54.649057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:54.649482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:54.787450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:54.795897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-efb127c3-701c-4702-9b3f-1862ed63926d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.158188 Mar 08 19:49:54.796766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 182/346] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:54 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:55.050872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:55.051570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:55.058004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.058462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.059214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.059648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.195769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:55.204060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:55.205624 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:55.206742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2a776d2d-8be7-4ed5-b270-ad578cdaf681 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1724 microversion: 2.20 time: 0.160541 Mar 08 19:49:55.207421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 165/347] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:55 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:55.224541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5ac4c530-6467-4535-ba0d-b97ef466c524 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df43e13-dccd-4040-ad19-fa248499cfe4"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:55.225640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5ac4c530-6467-4535-ba0d-b97ef466c524 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:55.232349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac4c530-6467-4535-ba0d-b97ef466c524 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.232780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac4c530-6467-4535-ba0d-b97ef466c524 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.233543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac4c530-6467-4535-ba0d-b97ef466c524 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.233979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac4c530-6467-4535-ba0d-b97ef466c524 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.379908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:55.380837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:55.386783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.387309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.388089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.388547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.533620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:55.537913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5ac4c530-6467-4535-ba0d-b97ef466c524 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317806 Mar 08 19:49:55.538514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 183/348] 10.222.0.45 () {62 vars in 1363 bytes} [Tue Mar 8 19:49:55 2022] POST /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:49:55.542747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f74a3bd7-07d4-44ba-9607-806080eb3da7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.167483 Mar 08 19:49:55.543443 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 166/349] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:55 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:55.650037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a5d2d28e-0a4f-49f9-aa85-bb99988bada9 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:55.650605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a5d2d28e-0a4f-49f9-aa85-bb99988bada9 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:55.657993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5d2d28e-0a4f-49f9-aa85-bb99988bada9 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.658447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5d2d28e-0a4f-49f9-aa85-bb99988bada9 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.659270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5d2d28e-0a4f-49f9-aa85-bb99988bada9 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.659741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5d2d28e-0a4f-49f9-aa85-bb99988bada9 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.750682 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a5d2d28e-0a4f-49f9-aa85-bb99988bada9 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/action" status: 202 len: 0 microversion: 2.20 time: 0.104447 Mar 08 19:49:55.751367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 184/350] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Mar 8 19:49:55 2022] POST /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:49:55.759307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:55.759911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:55.765781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.766229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.767000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.767438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.813565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:55.814172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:55.820034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.820527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.821304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:55.821740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:55.933253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:55.942391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:55.943916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:55.945082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-878ba5e7-d110-4268-9008-e1e2cb58fcb4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1750 microversion: 2.20 time: 0.189736 Mar 08 19:49:55.946002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 167/351] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:55 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1750 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:56.005054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:56.014183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d73e4c65-680e-437a-bfb3-03290ffa37dc tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.204570 Mar 08 19:49:56.015611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 185/352] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:55 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:56.559348 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:56.559960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:56.566242 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:56.566877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:56.567637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:56.568060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:56.723984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:56.736891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f148bddf-80ce-4d94-8c89-fc57f9bbce23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.181761 Mar 08 19:49:56.739069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 168/353] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:56 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:56.965558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:56.966161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:56.973553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:56.974096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:56.975039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:56.975487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:57.034838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:57.036226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:57.047080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:57.052962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:57.053950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:57.054610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:57.180713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:57.191687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:57.193659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:57.195422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3c23d0d0-f3e6-48f6-8ea9-9aec1349653c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1752 microversion: 2.20 time: 0.234548 Mar 08 19:49:57.196377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 186/354] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:56 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:57.307244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:57.318946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-82789c59-08e2-433d-b92e-cede78f488f1 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.291001 Mar 08 19:49:57.320116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 169/355] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:57 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:57.758802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:57.759418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:57.777010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:57.779090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:57.780991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:57.781581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:57.929806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:57.937644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8ab7a380-949e-404b-8e97-b57813668726 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.186127 Mar 08 19:49:57.938293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 187/356] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:58.214204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:58.214838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:58.222116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:58.222806 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:58.223595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:58.224024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:58.336559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:58.337172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:58.343549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:58.344001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:58.344801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:58.345242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:58.425403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:58.437303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:58.439016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:58.440172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1e70f048-2a07-44bf-becb-81ba87e9ffe5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.229902 Mar 08 19:49:58.440764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 170/357] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:58 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:49:58.507503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:58.515838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-069ec2b8-65c6-4f55-a93f-8987d80d4aeb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.182997 Mar 08 19:49:58.517041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 188/358] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:58 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:49:58.776155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-2fddc240-b478-4789-911d-262b929f865f req-2f94737e-8ace-4709-b1b8-7e0c0a57f848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ec178e-8ba4-4606-8aa8-131038fc027e", "name": "network-vif-plugged", "status": "completed", "tag": "bf60bdec-d657-4193-8d4c-6d75b8d18de9"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:49:58.788607 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-2fddc240-b478-4789-911d-262b929f865f req-2f94737e-8ace-4709-b1b8-7e0c0a57f848 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:58.789341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-2fddc240-b478-4789-911d-262b929f865f req-2f94737e-8ace-4709-b1b8-7e0c0a57f848 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:58.799987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-2fddc240-b478-4789-911d-262b929f865f req-2f94737e-8ace-4709-b1b8-7e0c0a57f848 service nova] Creating event network-vif-plugged:bf60bdec-d657-4193-8d4c-6d75b8d18de9 for instance 08ec178e-8ba4-4606-8aa8-131038fc027e on hv-cinder-83009 Mar 08 19:49:58.805027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-2fddc240-b478-4789-911d-262b929f865f req-2f94737e-8ace-4709-b1b8-7e0c0a57f848 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032944 Mar 08 19:49:58.805634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 171/359] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:49:58.954309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:58.954920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:58.961205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:58.961660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:58.962426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:58.962859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:59.105256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:59.113664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d2e8e64f-d3ea-4412-bb6f-ee0a0406481b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.163113 Mar 08 19:49:59.114796 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 189/360] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:49:59.461500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:59.462980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:59.478472 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:59.479478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:59.481826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:59.485912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:59.533081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:49:59.534315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:49:59.551868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:59.552613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:59.553720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:49:59.554318 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:49:59.688705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:59.702742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:59.704724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:59.706178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0464303c-1919-4e69-bfba-f8ef6159f061 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.250916 Mar 08 19:49:59.711819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 172/361] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:49:59 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:49:59.757569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:49:59.766582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b0f1a1bb-159e-42e0-8b9b-2ff65dc60cbb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.237254 Mar 08 19:49:59.767152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 190/362] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:49:59 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:00.130912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:00.131611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:00.138393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:00.138838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:00.139614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:00.140044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:00.282599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:00.290688 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c2d55a98-f80a-477d-a082-99122742cc43 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.163480 Mar 08 19:50:00.291275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 173/363] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:00.729947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:00.730608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:00.737748 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:00.738201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:00.738983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:00.739419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:00.784260 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:00.784867 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:00.791352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:00.791801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:00.792589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:00.793056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:00.911998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:00.920986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:00.922671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:00.923866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dfbefbcb-d8b0-4f13-b339-cd4230ef015c tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.198275 Mar 08 19:50:00.924475 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 191/364] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:00 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:00.953578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:00.961950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-83679b9c-c7a0-4927-b046-f1eda2746b02 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.181327 Mar 08 19:50:00.974677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 174/365] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:00 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:01.307891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:01.309139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:01.316191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:01.316991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:01.318001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:01.318504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:01.466051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:01.473926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f4def64d-d105-4680-bac9-9d8ef21ed9ec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.170704 Mar 08 19:50:01.474716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 192/366] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:01 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:01.943892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:01.944749 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:01.953690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:01.954141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:01.955015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:01.955456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:01.986108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:01.986828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:01.993272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:01.995064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:01.996883 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:01.997572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:02.126444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:02.136175 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:02.140730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:02.140730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3a343c1e-70f9-44a9-b249-0ae621fe14b4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.199695 Mar 08 19:50:02.147590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 175/367] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:01 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:02.173836 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:02.181931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7acbf119-61d0-47eb-953b-ff2ef7179069 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.199705 Mar 08 19:50:02.182510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 193/368] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:01 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:02.490669 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:02.491294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:02.500448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:02.500892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:02.501971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:02.502413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:02.646524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:02.654158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fff7676b-b97f-40d4-a49b-8a36ec7ffe3e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.167957 Mar 08 19:50:02.654732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 176/369] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:02 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:03.158156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:03.158758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:03.165572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:03.166024 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:03.166800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:03.167236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:03.199002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:03.199616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:03.206733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:03.207249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:03.208041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:03.208861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:03.312863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:03.326437 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:03.328026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:03.329141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bd7ee947-97c5-4db5-8e56-0e94d27bc79a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.174856 Mar 08 19:50:03.329917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 194/370] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:03 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:50:03.362899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:03.370712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dfa44bef-0b6f-42ba-aadc-cb98eda3d02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.175642 Mar 08 19:50:03.371243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 177/371] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:03 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:03.671272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:03.671798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:03.677932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:03.678381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:03.679238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:03.679681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:03.831053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:03.838474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-12b0b45b-2ced-457a-b460-7f6f585040f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.171482 Mar 08 19:50:03.839192 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 195/372] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:04.346949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:04.347555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:04.353897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:04.354343 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:04.355102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:04.356641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:04.389497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:04.390212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:04.399866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:04.400641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:04.401450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:04.401890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:04.500341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:04.508637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:04.510138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:04.511279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8e579237-06d2-43d2-9f7a-b50075ec0986 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.168219 Mar 08 19:50:04.512413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 178/373] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:04 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:04.549780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:04.557911 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fa491795-7b0e-4fb1-a721-afe023f1f575 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.174251 Mar 08 19:50:04.558998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 196/374] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:04 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:04.855508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:04.856122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:04.862466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:04.862959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:04.863825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:04.864395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:05.012245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:05.019733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c49d1698-9436-4fb7-bd9d-fed52152b455 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.168628 Mar 08 19:50:05.020308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 179/375] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:04 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:05.530156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:05.530749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:05.537149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:05.537606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:05.538400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:05.539105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:05.575476 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:05.576906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:05.583851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:05.584442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:05.585319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:05.585813 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:05.702570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:05.713999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:05.716107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:05.717529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-44887c93-71b2-4d80-890f-870ad51df3ef tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.191412 Mar 08 19:50:05.729088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 197/376] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:05 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:05.742426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:05.750264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8849bbdc-abc4-4714-8b3b-4b2066343bac tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.179235 Mar 08 19:50:05.750834 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 180/377] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:05 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:06.037106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:06.037878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:06.044090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:06.044645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:06.045498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:06.046009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:06.193189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:06.201974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9a0c4d65-5190-459a-96e4-053bd9336901 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.168589 Mar 08 19:50:06.202554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 198/378] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:06 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:06.739498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:06.740260 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:06.750655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:06.751389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:06.752306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:06.752758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:06.767737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:06.770512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:06.779530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:06.780659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:06.781815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:06.782472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:06.910352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:06.921503 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:06.922479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:06.923635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e6546209-b1ea-47da-8518-deb5731a332f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.189502 Mar 08 19:50:06.924545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 181/379] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:06 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:50:06.941484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:06.951643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-007ba36c-89be-43b8-88ea-5aeccbd19526 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.188323 Mar 08 19:50:06.952211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 199/380] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:06 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:07.219994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:07.220631 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:07.226835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:07.227279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:07.228187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:07.228702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:07.368042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:07.375278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0b35e345-388c-4e5a-b542-0a64f7ba2481 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.159225 Mar 08 19:50:07.375837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 182/381] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:07 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:07.941918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:07.942944 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:07.949293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:07.949746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:07.950530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:07.950958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:07.969126 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:07.970407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:07.979326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:07.981873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:07.982843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:07.983417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:08.115762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:08.127984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:08.129595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:08.130753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9b9b7499-5799-4e61-b133-4daed901747e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.192765 Mar 08 19:50:08.131416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 200/382] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:07 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:08.158970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:08.169294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d9daeb4f-41a0-4092-bb05-86f0dbc6e00f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.204484 Mar 08 19:50:08.179526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 183/383] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:07 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:08.396603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:08.397602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:08.405709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:08.406183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:08.406959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:08.407396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:08.552647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:08.560591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-38db1423-b059-463f-b762-573ff664a1c2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.173507 Mar 08 19:50:08.561493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 201/384] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:08 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:09.152552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:09.153280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:09.160111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:09.160596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:09.161368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:09.161797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:09.191009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:09.193053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:09.206232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:09.207080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:09.215363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:09.215925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:09.322591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:09.346588 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:09.348597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:09.349827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3ab96619-1e0a-427c-9e25-17288d944d97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.204895 Mar 08 19:50:09.350681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 184/385] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:09 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:09.382442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:09.390718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-60a60ce4-71b9-49cf-ba34-5433f8a48147 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.203959 Mar 08 19:50:09.391294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 202/386] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:09 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:09.577663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:09.578284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:09.584985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:09.585436 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:09.586210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:09.586641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:09.767510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:09.774914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7b622c58-40c3-4872-873d-30dfc071bd16 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.201575 Mar 08 19:50:09.775490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 185/387] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:10.368015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:10.368709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:10.375619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:10.376100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:10.376904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:10.377386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:10.408363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:10.408958 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:10.415846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:10.416317 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:10.417085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:10.417649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:10.510844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:10.519610 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:10.521276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:10.522424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-65030faa-9039-4652-b613-bc49ba945443 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.158306 Mar 08 19:50:10.522983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 203/388] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:10 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:10.549031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:10.557141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eeb3de96-ce7b-40b4-9a9f-1110cf314fb2 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.152522 Mar 08 19:50:10.557722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 186/389] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:10 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:10.793041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:10.793584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:10.799404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:10.799857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:10.800655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:10.801092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:10.938449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:10.945654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c7d24995-bbc4-4818-be25-a73f18c1504c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.156832 Mar 08 19:50:10.946222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 204/390] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:10 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:11.541726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:11.542291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:11.548783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:11.549229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:11.549989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:11.550422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:11.575515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:11.577433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:11.584076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:11.584556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:11.585417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:11.585771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:11.685729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:11.694057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:11.695578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:11.696743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6a1aaa5c-0c16-4df9-97d3-c43873811836 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.159993 Mar 08 19:50:11.697322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 187/391] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:11 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:11.728586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:11.736993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a56d95f5-f8e2-47e3-8861-92449c7783cb tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.165998 Mar 08 19:50:11.737582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 205/392] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:11 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:11.962166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:11.962768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:11.968504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:11.968951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:11.969712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:11.970146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:12.110805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:12.121939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-69a70b59-03e4-4346-b770-d5559c46bdc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1260 microversion: 2.1 time: 0.163517 Mar 08 19:50:12.122523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 188/393] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:12.714264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:12.715478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:12.721641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:12.722089 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:12.722845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:12.723279 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:12.753450 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:12.754062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:12.760375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:12.760829 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:12.762112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:12.762553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:12.855903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:12.864423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:12.866020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:12.867168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-12961f49-9ba6-4039-bf08-5ed087882d27 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.156952 Mar 08 19:50:12.867731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 206/394] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:12 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:12.896485 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:12.905173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f32362e0-3c3e-49eb-be1a-2c1bd84ca3ee tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.155499 Mar 08 19:50:12.905743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 189/395] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:12 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:13.140639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:13.141238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:13.146955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.147422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:13.148179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.148668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:13.282629 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:13.290187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fb4e9d8f-1ff3-4f46-9cf2-cbe4700eeb77 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1443 microversion: 2.1 time: 0.155230 Mar 08 19:50:13.290755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 207/396] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:13.306844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:13.307453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:13.313795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.314245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:13.315016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.315451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:13.521666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:13.529512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-90d6c1d1-55b9-4f3f-a329-125b49df70bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1443 microversion: 2.1 time: 0.226431 Mar 08 19:50:13.530078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 190/397] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:13.886103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:13.886706 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:13.892856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.893306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:13.894066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.894497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:13.922680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:13.923367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:13.929508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.929952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:13.930710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:13.931137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:14.066590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:14.075016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ad62f45c-82e8-4bc0-90cd-5e49e0a5c2a5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.156411 Mar 08 19:50:14.075577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 191/398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:13 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:14.120313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:14.128803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:14.130310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:14.131493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0fda48b3-e704-4346-8b7e-fcdeb199df62 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.249366 Mar 08 19:50:14.132046 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 208/399] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:13 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:15.091436 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:15.092142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:15.098416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:15.098863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:15.099627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:15.100057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:15.150257 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:15.150870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:15.158040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:15.158497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:15.159324 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:15.159759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:15.239534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:15.247945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e27a5ba7-e741-400f-9432-c88c4680fa38 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.160875 Mar 08 19:50:15.248539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 192/400] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:15 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:15.409957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:15.418985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:15.420535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:15.421716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ff3fc1ab-ee84-4f7d-8786-1baa01b08da0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.275384 Mar 08 19:50:15.422275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 209/401] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:15 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:50:15.691523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-1335a421-236c-4c43-b087-c148dd0282bf req-73cbde94-41d6-4233-a2f3-664ee8053c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ec178e-8ba4-4606-8aa8-131038fc027e", "tag": "bf60bdec-d657-4193-8d4c-6d75b8d18de9"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:15.700184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-1335a421-236c-4c43-b087-c148dd0282bf req-73cbde94-41d6-4233-a2f3-664ee8053c1d service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:15.700750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-1335a421-236c-4c43-b087-c148dd0282bf req-73cbde94-41d6-4233-a2f3-664ee8053c1d service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:15.712030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-1335a421-236c-4c43-b087-c148dd0282bf req-73cbde94-41d6-4233-a2f3-664ee8053c1d service nova] Creating event network-changed:bf60bdec-d657-4193-8d4c-6d75b8d18de9 for instance 08ec178e-8ba4-4606-8aa8-131038fc027e on hv-cinder-83009 Mar 08 19:50:15.717408 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-1335a421-236c-4c43-b087-c148dd0282bf req-73cbde94-41d6-4233-a2f3-664ee8053c1d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029477 Mar 08 19:50:15.718386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 193/402] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:50:16.265503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:16.266112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:16.272552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:16.273003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:16.274005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:16.274449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:16.421566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:16.429811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-334fcc7b-d157-41ad-8773-68da7b5a938b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.168794 Mar 08 19:50:16.431195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 210/403] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:16 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:16.439967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:16.441347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:16.447915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:16.448541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:16.449888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:16.450340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:16.652674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:16.661520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:16.663054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:16.664699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-af9356d7-7647-4f90-859b-334b525f1b53 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.228993 Mar 08 19:50:16.665246 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 194/404] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:16 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:50:17.447007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:17.447709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:17.453948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:17.454451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:17.455256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:17.455689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:17.584254 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:17.592506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-43cba4e5-f2e3-4357-9d03-ed8b530c4257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.149368 Mar 08 19:50:17.593070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 211/405] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:17 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:17.682921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:17.683509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:17.689821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:17.690268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:17.691028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:17.691462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:17.820135 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:17.828925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:17.830428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:17.831561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-241b3f9c-6742-4ee9-9e21-d8416f591b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.152594 Mar 08 19:50:17.832116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 195/406] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:17 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:50:18.609239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:18.609838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:18.615973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:18.616457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:18.617211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:18.617640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:18.748713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:18.756450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-937b0245-82f8-41b6-a4cd-53dd6cfff257 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.150986 Mar 08 19:50:18.757011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 212/407] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:18 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:18.850150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:18.850699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:18.857012 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:18.857462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:18.858232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:18.858665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:18.983875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:18.992119 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:18.993666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:18.994795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4f06279d-5940-48ea-809f-48c2ba2ede18 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.148577 Mar 08 19:50:18.995347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 196/408] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:18 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:19.773683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:19.774291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:19.781200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:19.781641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:19.782422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:19.782868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:19.910465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:19.918328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e94bfca1-1f49-4126-8970-c7885e34a64d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.148561 Mar 08 19:50:19.918883 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 213/409] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:19 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:20.013122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:20.013657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:20.019834 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:20.020273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:20.021053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:20.021484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:20.153827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:20.161981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:20.163491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:20.165051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-527836ec-3612-432f-902b-a4b685835c00 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.156456 Mar 08 19:50:20.165608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 197/410] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:20 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:20.935614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:20.936609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:20.942519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:20.942960 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:20.944515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:20.945160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:21.141802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:21.152862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-10bfa2d6-a026-4f33-b8a2-39bf0f2b9c92 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.221627 Mar 08 19:50:21.154131 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 214/411] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:20 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:21.182809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:21.183498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:21.189976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:21.190411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:21.192817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:21.194053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:21.357482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:21.366708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:21.368366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:21.369619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8d5f03aa-5b96-45ce-9dad-06758ceb65d3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.190645 Mar 08 19:50:21.370271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 198/412] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:21 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:50:22.170448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:22.170989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:22.177300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:22.177751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:22.178537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:22.178971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:22.312952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:22.320736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2f7aa35f-254e-4bc5-a9e4-73ba84aca80d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.154178 Mar 08 19:50:22.321304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 215/413] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:22 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:22.389160 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:22.389799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:22.396137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:22.396615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:22.397392 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:22.397884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:22.548236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:22.556513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:22.558028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:22.559171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-790769b4-24f5-472a-9a17-4d2081e4343a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.174716 Mar 08 19:50:22.559725 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 199/414] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:22 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:22.795813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-ff2963c0-2c91-40b0-b66e-258f9f4980a8 req-87c64fdf-acb1-49ba-bf4a-a801053c19b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb7515f-c5d4-4330-a70a-c1835a5556c4", "name": "network-vif-plugged", "status": "completed", "tag": "38ecd555-5c0f-44c2-850e-97cbfeea62d4"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:22.805029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ff2963c0-2c91-40b0-b66e-258f9f4980a8 req-87c64fdf-acb1-49ba-bf4a-a801053c19b9 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:22.806134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ff2963c0-2c91-40b0-b66e-258f9f4980a8 req-87c64fdf-acb1-49ba-bf4a-a801053c19b9 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:22.818236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-ff2963c0-2c91-40b0-b66e-258f9f4980a8 req-87c64fdf-acb1-49ba-bf4a-a801053c19b9 service nova] Creating event network-vif-plugged:38ecd555-5c0f-44c2-850e-97cbfeea62d4 for instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 on hv-cinder-83009 Mar 08 19:50:22.823479 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-ff2963c0-2c91-40b0-b66e-258f9f4980a8 req-87c64fdf-acb1-49ba-bf4a-a801053c19b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031771 Mar 08 19:50:22.824043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 216/415] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:50:23.338095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:23.338724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:23.345245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:23.345695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:23.346465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:23.346900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:23.478447 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:23.486815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-566bf2ba-4e11-4f4e-bf65-4bb65a2f4f8f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1569 microversion: 2.1 time: 0.152542 Mar 08 19:50:23.487414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 200/416] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:23 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:23.578841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:23.579560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:23.585967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:23.586411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:23.587171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:23.587604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:23.719322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:23.727515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:23.729152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:23.730419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d427eb85-3109-4352-8cfd-e87670942ce7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.156310 Mar 08 19:50:23.731061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 217/417] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:23 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:24.504695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:24.505298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:24.511447 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.511891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.512665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.513095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.641769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:24.649423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f5f2cbe9-df00-4377-b96a-e9ac72939aba tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1549 microversion: 2.1 time: 0.148547 Mar 08 19:50:24.650006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 201/418] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:24 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:24.665837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:24.666358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:24.673163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.673603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.674355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.674782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.749309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:24.749916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:24.755636 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.756027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.756816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.757247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.793949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] HTTP exception thrown: Cannot 'detach_volume' instance aae2ebb6-0a33-4828-9401-549caf63b885 while it is in vm_state rescued Mar 08 19:50:24.794542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Returning 409 to user: Cannot 'detach_volume' instance aae2ebb6-0a33-4828-9401-549caf63b885 while it is in vm_state rescued {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:50:24.795396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-12bec1d3-a7be-4fff-a827-d17f46bfdf63 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "DELETE /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments/55302db9-78f8-48c4-bb3e-e29716973769" status: 409 len: 152 microversion: 2.1 time: 0.133878 Mar 08 19:50:24.795946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 218/419] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 19:50:24 2022] DELETE /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments/55302db9-78f8-48c4-bb3e-e29716973769 => generated 152 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 08 19:50:24.803998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e9b293a1-e478-491e-ad5b-2107e4b9b812 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:24.804551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e9b293a1-e478-491e-ad5b-2107e4b9b812 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:24.811408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e9b293a1-e478-491e-ad5b-2107e4b9b812 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.811851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e9b293a1-e478-491e-ad5b-2107e4b9b812 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.812633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e9b293a1-e478-491e-ad5b-2107e4b9b812 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.813061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e9b293a1-e478-491e-ad5b-2107e4b9b812 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.876788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e9b293a1-e478-491e-ad5b-2107e4b9b812 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action" status: 202 len: 0 microversion: 2.1 time: 0.076161 Mar 08 19:50:24.877479 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 219/420] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:50:24 2022] POST /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:50:24.885712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:24.886400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:24.892487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.892943 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.893715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:24.894150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:24.894991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:24.905480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:24.907140 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:24.908315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-da013f36-381e-46b3-9fbc-e9041f232d5d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1808 microversion: 2.20 time: 0.163373 Mar 08 19:50:24.908861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 202/421] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:24 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:50:25.038719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:25.046534 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3e0a61a9-efaa-4b10-bdf3-8b5edd1d715b tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1557 microversion: 2.1 time: 0.164811 Mar 08 19:50:25.047087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 220/422] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:24 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:25.926941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:25.928170 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:25.934473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:25.935003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:25.936395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:25.936842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:26.065267 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:26.065904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:26.070980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:26.071604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:26.072710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:26.073494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:26.073936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:26.079225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:26.080859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:26.082083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9f9500ee-4b0e-43b3-859d-98772909dcf0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1795 microversion: 2.20 time: 0.159106 Mar 08 19:50:26.082724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 203/423] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:50:25 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:50:26.205758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:26.213513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b5296b97-bab9-45b0-8108-f8ab6f6cf30d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1557 microversion: 2.1 time: 0.153251 Mar 08 19:50:26.214075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 221/424] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:26 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:27.230842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:27.231452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:27.237798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:27.238247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:27.239013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:27.239449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:27.366849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:27.374640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-20440c85-62b8-4cc6-981f-e4eaf20da292 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1557 microversion: 2.1 time: 0.147615 Mar 08 19:50:27.375204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 204/425] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:27 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:28.391591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:28.392113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:28.398590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:28.399038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:28.399804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:28.400231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:28.533303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:28.541181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6d6cfd2d-5dca-4131-8f3e-c320254e3be5 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1563 microversion: 2.1 time: 0.153522 Mar 08 19:50:28.541737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 222/426] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:28 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:28.611616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:28.612093 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:28.618293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:28.618733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:28.619492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:28.619923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:28.748325 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lazy-loading 'services' on Instance uuid aae2ebb6-0a33-4828-9401-549caf63b885 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:50:28.856988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-17315fb0-3c61-464a-a569-59901268cf03 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "DELETE /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments/55302db9-78f8-48c4-bb3e-e29716973769" status: 202 len: 0 microversion: 2.1 time: 0.249380 Mar 08 19:50:28.857577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 205/427] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 19:50:28 2022] DELETE /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments/55302db9-78f8-48c4-bb3e-e29716973769 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:50:28.865825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-73601bc3-9a5c-4375-872d-679d9b19eb24 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:28.866814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-73601bc3-9a5c-4375-872d-679d9b19eb24 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:28.872821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73601bc3-9a5c-4375-872d-679d9b19eb24 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:28.873311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73601bc3-9a5c-4375-872d-679d9b19eb24 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:28.874084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73601bc3-9a5c-4375-872d-679d9b19eb24 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:28.874552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73601bc3-9a5c-4375-872d-679d9b19eb24 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:28.903768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-73601bc3-9a5c-4375-872d-679d9b19eb24 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041738 Mar 08 19:50:28.904927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 223/428] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:50:28 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:50:29.916171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d0055833-e644-4706-9f16-8a49797458cd tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:29.917554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d0055833-e644-4706-9f16-8a49797458cd tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:29.924662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0055833-e644-4706-9f16-8a49797458cd tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:29.925107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0055833-e644-4706-9f16-8a49797458cd tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:29.925856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0055833-e644-4706-9f16-8a49797458cd tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:29.926284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0055833-e644-4706-9f16-8a49797458cd tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:29.952937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d0055833-e644-4706-9f16-8a49797458cd tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041378 Mar 08 19:50:29.953471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 206/429] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:50:29 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:50:32.264354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:32.264854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:32.271623 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:32.272070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:32.272872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:32.273310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:32.296242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:50:32.370714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f2257f09-ecf7-465c-8c8c-14846b154ee4 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 204 len: 0 microversion: 2.1 time: 0.109739 Mar 08 19:50:32.371277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 224/430] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:50:32 2022] DELETE /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:50:32.380468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:32.381054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:32.387291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:32.387736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:32.388522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:32.388949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:32.522312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:32.529417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-589292d1-bb9e-4880-b45d-8b0a4896e02c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1508 microversion: 2.1 time: 0.153821 Mar 08 19:50:32.529973 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 207/431] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:32 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:33.547085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:33.547698 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:33.553935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:33.554382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:33.555144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:33.555578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:33.684373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:33.691998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6540aae0-883b-44ad-b2ac-a1b44fb3c6b9 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1508 microversion: 2.1 time: 0.149291 Mar 08 19:50:33.692585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 225/432] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:33 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:34.708197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:34.708843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:34.715114 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:34.715563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:34.716351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:34.716789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:34.848364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:34.855588 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e5dfd509-ca89-4df1-8ccf-f6e7da7eb18f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1508 microversion: 2.1 time: 0.151289 Mar 08 19:50:34.856148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 208/433] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:34 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:35.521193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-c59ace13-5b0d-4c07-80fe-fab645a62dfd req-c62369f4-58b0-4b08-903e-fd670140f0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfa0df4-9973-4370-a11d-492708232495", "name": "network-vif-deleted", "tag": "dd0094c5-2d50-493d-af72-15d0f09deacf"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:35.531218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-c59ace13-5b0d-4c07-80fe-fab645a62dfd req-c62369f4-58b0-4b08-903e-fd670140f0a8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:35.531672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-c59ace13-5b0d-4c07-80fe-fab645a62dfd req-c62369f4-58b0-4b08-903e-fd670140f0a8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:35.544174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-c59ace13-5b0d-4c07-80fe-fab645a62dfd req-c62369f4-58b0-4b08-903e-fd670140f0a8 service nova] Creating event network-vif-deleted:dd0094c5-2d50-493d-af72-15d0f09deacf for instance 4cfa0df4-9973-4370-a11d-492708232495 on hv-cinder-83009 Mar 08 19:50:35.549958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-c59ace13-5b0d-4c07-80fe-fab645a62dfd req-c62369f4-58b0-4b08-903e-fd670140f0a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 Mar 08 19:50:35.550550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 226/434] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:50:35.871133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:35.871730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:35.878282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:35.878730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:35.879491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:35.879926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:35.911684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:35.912134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:35.912612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lazy-loading 'fault' on Instance uuid 4cfa0df4-9973-4370-a11d-492708232495 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:50:35.955314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:35.962309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f32463c7-bd76-4b0c-ab0b-8cd548bebf1c tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 200 len: 1312 microversion: 2.1 time: 0.094950 Mar 08 19:50:35.962868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 209/435] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:35 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:36.820225 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:36.820855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:36.827282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:36.827734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:36.828526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:36.828964 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:36.906672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lazy-loading 'services' on Instance uuid 477b451d-e030-4691-965c-19224d84c9b4 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:50:36.979437 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:36.980077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: 4cfa0df4-9973-4370-a11d-492708232495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:36.986007 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:36.986972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:36.987780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:36.988157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:37.001703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] HTTP exception thrown: Instance 4cfa0df4-9973-4370-a11d-492708232495 could not be found. Mar 08 19:50:37.002925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Returning 404 to user: Instance 4cfa0df4-9973-4370-a11d-492708232495 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:50:37.003741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-43783331-6619-4ba4-9720-2bf90c8357e7 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495" status: 404 len: 111 microversion: 2.1 time: 0.028218 Mar 08 19:50:37.004655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 210/436] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:36 2022] GET /compute/v2.1/servers/4cfa0df4-9973-4370-a11d-492708232495 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:50:37.012534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:37.013027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:37.015252 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d0ea2de4-38df-4776-80f3-2c7fdc4e621b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-volume_attachments/a54ddba1-5863-4866-8ff5-1ec0eeb16996" status: 202 len: 0 microversion: 2.1 time: 0.199136 Mar 08 19:50:37.016031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 227/437] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 19:50:36 2022] DELETE /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-volume_attachments/a54ddba1-5863-4866-8ff5-1ec0eeb16996 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:50:37.018988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:37.019383 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:37.020153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:37.020682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:37.045513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:50:37.137139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bba4933c-7212-4e99-ad92-7bc2604f227f tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "DELETE /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 204 len: 0 microversion: 2.1 time: 0.127989 Mar 08 19:50:37.137703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 211/438] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:50:37 2022] DELETE /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 19:50:37.146321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:37.147003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:37.153039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:37.153482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:37.154244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:37.154671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:37.284123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:37.291691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c0d0853b-750a-470c-a086-7c318d295a0d tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.149728 Mar 08 19:50:37.292247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 228/439] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:37 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:38.137287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8f500b3c-b577-4c20-bd98-b86749dac5e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:38.144346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8f500b3c-b577-4c20-bd98-b86749dac5e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:38.144798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8f500b3c-b577-4c20-bd98-b86749dac5e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:38.165923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8f500b3c-b577-4c20-bd98-b86749dac5e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Going to try to stop instance {{(pid=123381) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 19:50:38.211509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8f500b3c-b577-4c20-bd98-b86749dac5e2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action" status: 202 len: 0 microversion: 2.1 time: 0.078238 Mar 08 19:50:38.212108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 212/440] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:50:38 2022] POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:50:38.220351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:38.221056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:38.227617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:38.228229 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:38.229183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:38.229675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:38.309356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:38.310050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:38.316617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:38.317066 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:38.317850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:38.318266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:38.364368 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:38.371613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a54dc534-df67-4753-bbe9-9f032d04c5fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.155187 Mar 08 19:50:38.372184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 229/441] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:38 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:38.453070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:38.461262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d3189404-9efd-4867-a7d0-1c7b7c79ca06 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.156101 Mar 08 19:50:38.461824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 213/442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:38 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:39.389268 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:39.389834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:39.396758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:39.397211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:39.397974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:39.398407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:39.477758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:39.478448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:39.484610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:39.485062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:39.485831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:39.486322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:39.526445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:39.535246 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-73675326-adad-4a8c-8eca-5e928dc0747a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.149702 Mar 08 19:50:39.535829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 230/443] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:39 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:39.624152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:39.631860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c41972e0-2290-46a8-8a51-d02d5ec763ed tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.157930 Mar 08 19:50:39.632557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 214/444] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:39 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:40.552873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:40.553493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:40.559586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:40.560027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:40.560808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:40.561245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:40.649151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:40.649754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:40.655943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:40.656424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:40.657195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:40.657628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:40.694803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:40.702084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d882dca6-f39c-426e-a68e-9979027b1aa7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.153105 Mar 08 19:50:40.702811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 231/445] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:40 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:40.786635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:40.794174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-61166815-8bb6-497e-adb1-7016ea5d19aa tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.148870 Mar 08 19:50:40.794725 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 215/446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:40 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:41.720348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:41.720950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:41.727329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:41.727782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:41.728669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:41.729234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:41.811371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:41.811761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:41.818369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:41.818816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:41.819591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:41.820024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:41.862074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:41.869604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3c921662-3181-4736-aa2e-6b17e3a2909e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.153064 Mar 08 19:50:41.870179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 232/447] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:41 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:41.953846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:41.960992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5fd2b966-6a49-4f49-b088-2a7ffea5a4cf tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.153864 Mar 08 19:50:41.961578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 216/448] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:41 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:42.886802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:42.887409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:42.893851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:42.894297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:42.895060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:42.897295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:42.977807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:42.978579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:42.985103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:42.985566 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:42.987001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:42.987555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.036623 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:43.044134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5366d058-ab9e-4200-a385-26cc57c9fd55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.161145 Mar 08 19:50:43.044728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 233/449] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:42 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:43.118959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:43.126316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a960c629-9bea-4b40-8f29-e1e4e7f00f60 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.152415 Mar 08 19:50:43.126880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 217/450] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:42 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:43.280770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e88f081b-f4ed-430c-9f9b-d44712bcb4e9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:43.281184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e88f081b-f4ed-430c-9f9b-d44712bcb4e9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:43.287668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e88f081b-f4ed-430c-9f9b-d44712bcb4e9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.288374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e88f081b-f4ed-430c-9f9b-d44712bcb4e9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.289172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e88f081b-f4ed-430c-9f9b-d44712bcb4e9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.289611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e88f081b-f4ed-430c-9f9b-d44712bcb4e9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.311216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e88f081b-f4ed-430c-9f9b-d44712bcb4e9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd/ips" status: 200 len: 149 microversion: 2.1 time: 0.034405 Mar 08 19:50:43.311768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 234/451] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:50:43 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:50:43.322277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63d0a72a-6765-422e-bf8b-f7750618fec4"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:43.323363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:43.329184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.329630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.330918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.331356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.406785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Invalid volume: volume 63d0a72a-6765-422e-bf8b-f7750618fec4 is already attached to instances: 5a53ea32-1838-4dd1-85b7-bae137389683 Mar 08 19:50:43.407382 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 400 to user: Invalid volume: volume 63d0a72a-6765-422e-bf8b-f7750618fec4 is already attached to instances: 5a53ea32-1838-4dd1-85b7-bae137389683 {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:50:43.407844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:50:43.408033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 19:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:50:43.408550 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-52215dc6-fb2e-4246-aed5-3ca952ebf6d7 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090361 Mar 08 19:50:43.409960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 218/452] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:50:43 2022] POST /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:50:43.424154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:43.424674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:43.430510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.431084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.431694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.432117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.456217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:50:43.527574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-84fd44a6-1445-483d-a5b5-aa2c4de30db5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 204 len: 0 microversion: 2.1 time: 0.106930 Mar 08 19:50:43.528170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 235/453] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:50:43 2022] DELETE /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:50:43.536981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:43.537531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:43.544337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.544887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.545653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:43.546090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:43.685458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:43.693127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2af6ef8b-d3d8-4fd2-a5d2-8ebbca50c3aa tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1681 microversion: 2.1 time: 0.160069 Mar 08 19:50:43.693678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 219/454] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:43 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:44.062026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:44.062720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:44.069502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:44.069952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:44.070716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:44.071149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:44.142948 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:44.143650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:44.149894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:44.150275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:44.151050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:44.151470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:44.209906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:44.217777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ec46596a-5962-454d-a6fd-fb25ac50213a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.160166 Mar 08 19:50:44.218347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 236/455] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:44 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:44.363664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-84fcbbe3-0375-4685-a5ba-2571ccbf9a1e req-e11a7ac7-ed1a-4fab-ab5b-dafb3c0e4b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae2ebb6-0a33-4828-9401-549caf63b885", "name": "network-vif-deleted", "tag": "3922c2b2-0487-47bb-b9e7-3f5915f09d4f"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:44.373472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-84fcbbe3-0375-4685-a5ba-2571ccbf9a1e req-e11a7ac7-ed1a-4fab-ab5b-dafb3c0e4b91 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:44.373922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-84fcbbe3-0375-4685-a5ba-2571ccbf9a1e req-e11a7ac7-ed1a-4fab-ab5b-dafb3c0e4b91 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:44.385685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-84fcbbe3-0375-4685-a5ba-2571ccbf9a1e req-e11a7ac7-ed1a-4fab-ab5b-dafb3c0e4b91 service nova] Creating event network-vif-deleted:3922c2b2-0487-47bb-b9e7-3f5915f09d4f for instance aae2ebb6-0a33-4828-9401-549caf63b885 on hv-cinder-83009 Mar 08 19:50:44.389281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2b1802092d482fb413906082477860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ed260f86604db6ac28144af3dfb647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:44.397573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-227974fe-423b-4af4-9928-930686b97bc6 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 200 len: 1523 microversion: 2.1 time: 0.258401 Mar 08 19:50:44.398002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-84fcbbe3-0375-4685-a5ba-2571ccbf9a1e req-e11a7ac7-ed1a-4fab-ab5b-dafb3c0e4b91 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038780 Mar 08 19:50:44.404975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 220/456] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:44 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:44.405539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 237/457] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:50:44.711283 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:44.711812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:44.717675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:44.718127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:44.718892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:44.719330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:44.856470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:44.863932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8a124af3-40d2-438c-b0db-73b8c02ef0fc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1681 microversion: 2.1 time: 0.156589 Mar 08 19:50:44.864515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 221/458] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:44 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:45.235296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:45.235985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:45.242963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:45.243412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:45.244182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:45.244641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:45.374815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:45.382813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-faaef2ca-a925-47a6-8d03-e75846b14341 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.151629 Mar 08 19:50:45.383378 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 238/459] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:45 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:45.414451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:45.415058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] [instance: aae2ebb6-0a33-4828-9401-549caf63b885] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:45.421306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:45.421751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:45.422516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:45.422952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:45.436154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] HTTP exception thrown: Instance aae2ebb6-0a33-4828-9401-549caf63b885 could not be found. Mar 08 19:50:45.436761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] Returning 404 to user: Instance aae2ebb6-0a33-4828-9401-549caf63b885 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:50:45.437562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-36990826-26f1-4db9-9fd4-3a48fc81e278 tempest-ServerRescueNegativeTestJSON-90446989 tempest-ServerRescueNegativeTestJSON-90446989-project] 10.222.0.45 "GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885" status: 404 len: 111 microversion: 2.1 time: 0.027306 Mar 08 19:50:45.438077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 222/460] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:45 2022] GET /compute/v2.1/servers/aae2ebb6-0a33-4828-9401-549caf63b885 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:50:45.882649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:45.883253 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:45.889040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:45.889492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:45.890265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:45.890700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:46.159038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:46.168927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a0e7c6b6-3b2a-4084-836a-750200d82fdc tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 200 len: 1681 microversion: 2.1 time: 0.290014 Mar 08 19:50:46.169714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 239/461] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:45 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:46.399976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:46.400613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:46.407578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:46.408311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:46.409335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:46.409941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:46.420342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-64d7fb36-d1a6-4e34-bc4c-a062637876f0 req-cef11093-5d61-415f-a529-2f651bfc1937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7092a06-ffd5-4d33-883b-eee953ed48fd", "name": "network-vif-deleted", "tag": "94b67e3f-c2ae-40cf-b44c-507ba8c0d290"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:46.440508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-64d7fb36-d1a6-4e34-bc4c-a062637876f0 req-cef11093-5d61-415f-a529-2f651bfc1937 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:46.440958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-64d7fb36-d1a6-4e34-bc4c-a062637876f0 req-cef11093-5d61-415f-a529-2f651bfc1937 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:46.484804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-64d7fb36-d1a6-4e34-bc4c-a062637876f0 req-cef11093-5d61-415f-a529-2f651bfc1937 service nova] Creating event network-vif-deleted:94b67e3f-c2ae-40cf-b44c-507ba8c0d290 for instance b7092a06-ffd5-4d33-883b-eee953ed48fd on hv-cinder-83009 Mar 08 19:50:46.500100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-64d7fb36-d1a6-4e34-bc4c-a062637876f0 req-cef11093-5d61-415f-a529-2f651bfc1937 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081394 Mar 08 19:50:46.500739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 240/462] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:50:46.607963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:46.631681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-728617e9-6110-439c-948d-8ec62c90702b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.235491 Mar 08 19:50:46.633745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 223/463] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:46 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:47.187098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:47.187789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:47.198512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:47.200504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:47.201683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:47.203572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:47.226588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance b7092a06-ffd5-4d33-883b-eee953ed48fd could not be found. Mar 08 19:50:47.227219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance b7092a06-ffd5-4d33-883b-eee953ed48fd could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:50:47.228049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e980b062-8c96-4d71-ae26-bff873cf0719 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 404 len: 111 microversion: 2.1 time: 0.045301 Mar 08 19:50:47.232025 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 241/464] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:47 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:50:47.237688 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d790e582-d475-4622-9fc5-c492fb8479fb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '.version_select at 0x7f0704f51280>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:47.257988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d790e582-d475-4622-9fc5-c492fb8479fb tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242998532" status: 202 len: 0 microversion: 2.1 time: 0.024590 Mar 08 19:50:47.263486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 224/465] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Mar 8 19:50:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242998532 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:50:47.650052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:47.651384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:47.668893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:47.669620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:47.677740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:47.678240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:47.948356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:47.959209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-92ad9fb5-6a36-4cca-b5c8-f33649eb1e03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.313447 Mar 08 19:50:47.968407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 242/466] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:47 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:48.419821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:48.420399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:48.429358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:48.430056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:48.431000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:48.431596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:48.520072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lazy-loading 'services' on Instance uuid 5a53ea32-1838-4dd1-85b7-bae137389683 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:50:48.593731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-add30c65-617d-432d-9d15-f1d7a478dce4 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments/63d0a72a-6765-422e-bf8b-f7750618fec4" status: 202 len: 0 microversion: 2.1 time: 0.178433 Mar 08 19:50:48.596080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 225/467] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 19:50:48 2022] DELETE /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments/63d0a72a-6765-422e-bf8b-f7750618fec4 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:50:48.604339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cf216047-bd08-49a0-96ec-77788ddd9a19 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:48.605493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cf216047-bd08-49a0-96ec-77788ddd9a19 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:48.612479 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf216047-bd08-49a0-96ec-77788ddd9a19 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:48.613144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf216047-bd08-49a0-96ec-77788ddd9a19 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:48.614092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf216047-bd08-49a0-96ec-77788ddd9a19 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:48.614689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf216047-bd08-49a0-96ec-77788ddd9a19 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:48.645301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cf216047-bd08-49a0-96ec-77788ddd9a19 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Mar 08 19:50:48.649926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 243/468] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:50:48 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:50:48.977739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:48.978683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:48.985106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:48.985583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:48.987210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:48.987715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:49.135050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:49.143635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-79dab8ab-3597-4f64-8c09-c7536d5bfe43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.170082 Mar 08 19:50:49.144207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 226/469] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:48 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:49.657505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9c00247c-b27a-4874-9acd-71d64c452104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:49.658395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9c00247c-b27a-4874-9acd-71d64c452104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:49.667190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c00247c-b27a-4874-9acd-71d64c452104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:49.667638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c00247c-b27a-4874-9acd-71d64c452104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:49.668478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c00247c-b27a-4874-9acd-71d64c452104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:49.668915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c00247c-b27a-4874-9acd-71d64c452104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:49.698517 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9c00247c-b27a-4874-9acd-71d64c452104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045107 Mar 08 19:50:49.699124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 244/470] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:50:49 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:50:49.776282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:49.776815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:49.785150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:49.785610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:49.786395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:49.786838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:49.815438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:50:49.891095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1abc1897-1c14-4dfa-a59f-de15e4400e0b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 204 len: 0 microversion: 2.1 time: 0.118380 Mar 08 19:50:49.891813 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 227/471] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:50:49 2022] DELETE /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:50:49.901082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:49.901821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:49.907766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:49.908219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:49.909027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:49.909459 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:50.044057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:50.051957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4ce55f1d-d0d1-4924-8d7b-d4cd72cb6ded tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1683 microversion: 2.1 time: 0.155481 Mar 08 19:50:50.052548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 245/472] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:49 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:50.161483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:50.162181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:50.169006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:50.169274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:50.170211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:50.170729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:50.329106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:50.336804 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8c870436-ec9e-40c6-9547-ccd8f4fb4e40 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.179991 Mar 08 19:50:50.337493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 228/473] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:50 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:51.069962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:51.070576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:51.076467 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:51.076920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:51.077887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:51.078334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:51.218854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:51.226508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-611a2686-b1b6-47a6-bfc3-de999ffe84f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1683 microversion: 2.1 time: 0.160610 Mar 08 19:50:51.227153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 246/474] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:51 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:51.353676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:51.354271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:51.360403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:51.360852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:51.362112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:51.362546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:51.497127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:51.505053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c3f7cce3-d68f-4695-9b6a-de9661edc763 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.155280 Mar 08 19:50:51.505601 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 229/475] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:51 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:52.244197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:52.244968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:52.251747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:52.252335 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:52.253177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:52.253686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:52.331541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:52.340614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-73bcfa68-004b-48a3-baea-52c01e768239 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 200 len: 1615 microversion: 2.1 time: 0.100127 Mar 08 19:50:52.341514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 247/476] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:52 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 1615 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:52.522863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:52.523619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:52.529984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:52.531100 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:52.532049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:52.532675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:52.790980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-63f841af-7ee9-4b1d-ac5f-bf2d91fc3f76 req-995df944-53a0-4880-8b91-f5aea0fd2821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a53ea32-1838-4dd1-85b7-bae137389683", "name": "network-vif-deleted", "tag": "04a354b0-ebaf-4bb1-8bd4-8311d12fae7f"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:52.792508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:52.802353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e4163976-5054-4a51-a879-6baa51937758 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1679 microversion: 2.1 time: 0.283380 Mar 08 19:50:52.803618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 230/477] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:52 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1679 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:52.807646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-63f841af-7ee9-4b1d-ac5f-bf2d91fc3f76 req-995df944-53a0-4880-8b91-f5aea0fd2821 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:52.808110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-63f841af-7ee9-4b1d-ac5f-bf2d91fc3f76 req-995df944-53a0-4880-8b91-f5aea0fd2821 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:52.830901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-63f841af-7ee9-4b1d-ac5f-bf2d91fc3f76 req-995df944-53a0-4880-8b91-f5aea0fd2821 service nova] Creating event network-vif-deleted:04a354b0-ebaf-4bb1-8bd4-8311d12fae7f for instance 5a53ea32-1838-4dd1-85b7-bae137389683 on hv-cinder-83009 Mar 08 19:50:52.836803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-63f841af-7ee9-4b1d-ac5f-bf2d91fc3f76 req-995df944-53a0-4880-8b91-f5aea0fd2821 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050104 Mar 08 19:50:52.837599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 248/478] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:50:53.358631 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:53.359394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:53.367056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:53.367501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:53.368405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:53.368748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:53.382668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance 5a53ea32-1838-4dd1-85b7-bae137389683 could not be found. Mar 08 19:50:53.383164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance 5a53ea32-1838-4dd1-85b7-bae137389683 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:50:53.383968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d808ace2-086f-41f6-87e8-1bff218c8472 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 404 len: 111 microversion: 2.1 time: 0.029311 Mar 08 19:50:53.384749 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 231/479] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:53 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:50:53.396050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-24e3189d-0bfe-4339-a504-5c52eacce75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '.version_select at 0x7f07046b2b80>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:53.422901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-24e3189d-0bfe-4339-a504-5c52eacce75a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950768704" status: 202 len: 0 microversion: 2.1 time: 0.032565 Mar 08 19:50:53.424164 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 249/480] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Mar 8 19:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950768704 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:50:53.820508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:53.821427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:53.833609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:53.834295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:53.835095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:53.835534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:54.082283 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:54.090919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6b63fe48-fcce-4b21-a6cd-0fac1e54a8ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1656 microversion: 2.1 time: 0.275299 Mar 08 19:50:54.102616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 232/481] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:53 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1656 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:54.112085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-55e0efed-f791-4783-87ad-b93ab2aacc9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:54.116869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-55e0efed-f791-4783-87ad-b93ab2aacc9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:54.117320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-55e0efed-f791-4783-87ad-b93ab2aacc9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:54.143236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-55e0efed-f791-4783-87ad-b93ab2aacc9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Going to try to start instance {{(pid=123380) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 19:50:54.193840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-55e0efed-f791-4783-87ad-b93ab2aacc9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action" status: 202 len: 0 microversion: 2.1 time: 0.089232 Mar 08 19:50:54.194879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 250/482] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:50:54 2022] POST /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:50:54.203284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:54.204094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:54.210716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:54.211175 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:54.222612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:54.222612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:54.232863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-94d645ad-4855-47a8-8750-2e61201b9fb9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: .version_select at 0x7f07047db0d0>, body: {"keypair": {"name": "tempest-keypair-1766152570"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:54.250801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-94d645ad-4855-47a8-8750-2e61201b9fb9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:50:54.254791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-94d645ad-4855-47a8-8750-2e61201b9fb9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:50:54.406296 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:54.418291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1dc2b0b7-a726-4a00-8555-e748a56078c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1665 microversion: 2.1 time: 0.218708 Mar 08 19:50:54.420118 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 233/483] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:54 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1665 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:54.474133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-94d645ad-4855-47a8-8750-2e61201b9fb9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:50:54.477972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-94d645ad-4855-47a8-8750-2e61201b9fb9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:50:54.493288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-94d645ad-4855-47a8-8750-2e61201b9fb9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.266607 Mar 08 19:50:54.494101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 251/484] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 19:50:54 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:55.436547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:55.437306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:55.444278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:55.444872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:55.445750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:55.446287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:55.591129 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:55.603307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f7931d0b-2879-41c5-85d0-f543c554df0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1665 microversion: 2.1 time: 0.170504 Mar 08 19:50:55.604102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 234/485] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:55 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:55.804440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-287207782", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dfea349b-6bfd-41c2-92c4-062cebf33ab6"}], "security_groups": [{"name": "tempest-securitygroup--1433079165"}], "key_name": "tempest-keypair-1766152570", "user_data": "}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:50:55.909406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] validate_networks() for [('dfea349b-6bfd-41c2-92c4-062cebf33ab6', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:50:56.483649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:50:56.484069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:50:56.484576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:50:56.484984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:50:56.485392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:50:56.494488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:56.494934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:56.495732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:56.496167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:56.511911 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:50:56.515744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:50:56.527359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:50:56.529739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:50:56.574489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-175687b9-2349-466e-8cb8-5216235900db tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779573 Mar 08 19:50:56.575133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 252/486] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:50:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:50:56.585599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b423908e-e3f0-45ff-8c7c-3b0e4b19ab68 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:56.586210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b423908e-e3f0-45ff-8c7c-3b0e4b19ab68 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:56.620490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:56.621100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:56.628053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:56.628526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:56.629299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:56.629737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:56.639294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b423908e-e3f0-45ff-8c7c-3b0e4b19ab68 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:56.647834 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b423908e-e3f0-45ff-8c7c-3b0e4b19ab68 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1241 microversion: 2.1 time: 0.066114 Mar 08 19:50:56.648427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 235/487] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:56 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:56.770348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:56.778830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-88d2b198-6a47-4d0c-b034-d84db1b3fae7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1669 microversion: 2.1 time: 0.162204 Mar 08 19:50:56.786902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 253/488] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:56 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:50:57.665240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:57.666013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:57.673158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:57.674174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:57.674959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:57.675398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:57.755714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:57.763025 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e73780bc-fe11-4ad6-aea8-968d414ca39a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1299 microversion: 2.1 time: 0.101952 Mar 08 19:50:57.763672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 236/489] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:57 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:58.779366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:58.779972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:58.786834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:58.787289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:58.788337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:58.788777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:58.915847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:50:58.923033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-eb06b935-3da1-4658-af7d-3591ef685207 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.147427 Mar 08 19:50:58.923539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 254/490] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:58 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:50:59.940027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:50:59.940652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:50:59.946821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:59.947264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:50:59.948023 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:50:59.948486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:00.078337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:00.086139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d317d190-f6ac-4305-af87-630c832326b9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.150458 Mar 08 19:51:00.086736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 237/491] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:50:59 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:00.889348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-70cfa4e7-cdff-488b-9357-0b5781340788 req-381cc74d-a4b1-4885-b0d3-6458e7be1209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37d3efc-2ed3-4421-8b7b-482ebff040b3", "tag": "8a12a54f-7ede-4f74-acbe-18594f4017ff"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:00.908039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-70cfa4e7-cdff-488b-9357-0b5781340788 req-381cc74d-a4b1-4885-b0d3-6458e7be1209 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:00.908532 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-70cfa4e7-cdff-488b-9357-0b5781340788 req-381cc74d-a4b1-4885-b0d3-6458e7be1209 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:00.925670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-70cfa4e7-cdff-488b-9357-0b5781340788 req-381cc74d-a4b1-4885-b0d3-6458e7be1209 service nova] Creating event network-changed:8a12a54f-7ede-4f74-acbe-18594f4017ff for instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 on hv-cinder-83009 Mar 08 19:51:00.931447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-70cfa4e7-cdff-488b-9357-0b5781340788 req-381cc74d-a4b1-4885-b0d3-6458e7be1209 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053478 Mar 08 19:51:00.932382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 255/492] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:01.102923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:01.103608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:01.110903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:01.111448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:01.112568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:01.113230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:01.341095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:01.350428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9f74bc94-0f09-4cdc-ba99-f2f82eea6399 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.251710 Mar 08 19:51:01.351263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 238/493] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:01 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:02.367921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:02.368863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:02.375254 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:02.375708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:02.376562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:02.377000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:02.511307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:02.521668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-02842107-1ba7-4220-95fc-0dd0699f2de5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.157939 Mar 08 19:51:02.522381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 256/494] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:02 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:03.538842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:03.539438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:03.545656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:03.546099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:03.546851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:03.547278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:03.685214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:03.693214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9b105105-517b-46a0-9563-8ec256765e2b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.158224 Mar 08 19:51:03.693805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 239/495] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:03 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:04.710856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:04.711469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:04.717717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:04.718182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:04.718960 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:04.719399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:04.921508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:04.929672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2953815c-9d29-49d1-8835-303f22c94e3f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.222493 Mar 08 19:51:04.936380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 257/496] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:04 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:05.947644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:05.949049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:05.955592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:05.955997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:05.956812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:05.957254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:06.090481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:06.098922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8682c0d0-58fa-4283-8cf3-246fa1006104 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.155895 Mar 08 19:51:06.099489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 240/497] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:05 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:06.465185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-38dd6c87-22d9-4a68-baad-704b0a5930ce req-dec5b615-1d37-419a-9d5d-51f1557f8d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37d3efc-2ed3-4421-8b7b-482ebff040b3", "name": "network-vif-plugged", "status": "completed", "tag": "8a12a54f-7ede-4f74-acbe-18594f4017ff"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:06.474460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-38dd6c87-22d9-4a68-baad-704b0a5930ce req-dec5b615-1d37-419a-9d5d-51f1557f8d7f service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:06.474906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-38dd6c87-22d9-4a68-baad-704b0a5930ce req-dec5b615-1d37-419a-9d5d-51f1557f8d7f service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:06.486887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-38dd6c87-22d9-4a68-baad-704b0a5930ce req-dec5b615-1d37-419a-9d5d-51f1557f8d7f service nova] Creating event network-vif-plugged:8a12a54f-7ede-4f74-acbe-18594f4017ff for instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 on hv-cinder-83009 Mar 08 19:51:06.492005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-38dd6c87-22d9-4a68-baad-704b0a5930ce req-dec5b615-1d37-419a-9d5d-51f1557f8d7f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030446 Mar 08 19:51:06.492651 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 258/498] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:07.116010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:07.117145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:07.122919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:07.123373 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:07.124327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:07.124775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:07.270967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:07.278445 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b7adeb4a-94e7-4d94-b87f-83d7cb385343 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1367 microversion: 2.1 time: 0.166631 Mar 08 19:51:07.279252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 241/499] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:07 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:08.297074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:08.297759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:08.304579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:08.305025 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:08.305783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:08.306215 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:08.441452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:08.450013 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d6b9bb16-d28d-4dcf-a820-3be155626205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1558 microversion: 2.1 time: 0.157581 Mar 08 19:51:08.450657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 259/500] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:08 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:08.467671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-aebfede1-f46f-4abd-880c-0ba0e282f208 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:08.468477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-aebfede1-f46f-4abd-880c-0ba0e282f208 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:08.475469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aebfede1-f46f-4abd-880c-0ba0e282f208 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:08.475918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aebfede1-f46f-4abd-880c-0ba0e282f208 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:08.476730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aebfede1-f46f-4abd-880c-0ba0e282f208 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:08.477181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aebfede1-f46f-4abd-880c-0ba0e282f208 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:08.564678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-aebfede1-f46f-4abd-880c-0ba0e282f208 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100903 Mar 08 19:51:08.565269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 242/501] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Mar 8 19:51:08 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:09.789139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-da952e6c-7ef6-403c-8b78-4d688993e1c1 req-231b2607-66df-42ad-95ee-a76bf648d924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37d3efc-2ed3-4421-8b7b-482ebff040b3", "tag": "8a12a54f-7ede-4f74-acbe-18594f4017ff"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:09.795621 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-da952e6c-7ef6-403c-8b78-4d688993e1c1 req-231b2607-66df-42ad-95ee-a76bf648d924 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:09.796272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-da952e6c-7ef6-403c-8b78-4d688993e1c1 req-231b2607-66df-42ad-95ee-a76bf648d924 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:09.807595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-da952e6c-7ef6-403c-8b78-4d688993e1c1 req-231b2607-66df-42ad-95ee-a76bf648d924 service nova] Creating event network-changed:8a12a54f-7ede-4f74-acbe-18594f4017ff for instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 on hv-cinder-83009 Mar 08 19:51:09.812697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-da952e6c-7ef6-403c-8b78-4d688993e1c1 req-231b2607-66df-42ad-95ee-a76bf648d924 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030105 Mar 08 19:51:09.814395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 260/502] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:11.805685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1fe6dcf4-76f4-423f-9d8b-932ab0af414f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:11.806298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1fe6dcf4-76f4-423f-9d8b-932ab0af414f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:11.812268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1fe6dcf4-76f4-423f-9d8b-932ab0af414f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:11.812761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1fe6dcf4-76f4-423f-9d8b-932ab0af414f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:11.813536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1fe6dcf4-76f4-423f-9d8b-932ab0af414f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:11.813978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1fe6dcf4-76f4-423f-9d8b-932ab0af414f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:11.841781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1fe6dcf4-76f4-423f-9d8b-932ab0af414f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments/8df43e13-dccd-4040-ad19-fa248499cfe4" status: 200 len: 194 microversion: 2.20 time: 0.040499 Mar 08 19:51:11.842345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 243/503] 10.222.0.45 () {60 vars in 1453 bytes} [Tue Mar 8 19:51:11 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments/8df43e13-dccd-4040-ad19-fa248499cfe4 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:51:11.903813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:11.904425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:11.910374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:11.910793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:11.911554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:11.911984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:11.990212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lazy-loading 'services' on Instance uuid 7fb7515f-c5d4-4330-a70a-c1835a5556c4 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:51:12.057178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-24a54bd6-50aa-4cb1-a2e5-7346556a5d65 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments/8df43e13-dccd-4040-ad19-fa248499cfe4" status: 202 len: 0 microversion: 2.20 time: 0.158031 Mar 08 19:51:12.057714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 261/504] 10.222.0.45 () {60 vars in 1456 bytes} [Tue Mar 8 19:51:11 2022] DELETE /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments/8df43e13-dccd-4040-ad19-fa248499cfe4 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:51:12.066536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0bc1fc12-5c0d-474b-bef7-54df8f767102 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:12.067492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0bc1fc12-5c0d-474b-bef7-54df8f767102 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:12.073258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0bc1fc12-5c0d-474b-bef7-54df8f767102 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:12.073910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0bc1fc12-5c0d-474b-bef7-54df8f767102 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:12.074579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0bc1fc12-5c0d-474b-bef7-54df8f767102 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:12.075062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0bc1fc12-5c0d-474b-bef7-54df8f767102 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:12.103562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0bc1fc12-5c0d-474b-bef7-54df8f767102 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041463 Mar 08 19:51:12.106090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 244/505] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Mar 8 19:51:12 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:51:13.116264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-049adf07-d431-437d-b768-7fa9233ac068 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:13.117325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-049adf07-d431-437d-b768-7fa9233ac068 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:13.123470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-049adf07-d431-437d-b768-7fa9233ac068 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:13.123919 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-049adf07-d431-437d-b768-7fa9233ac068 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:13.124719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-049adf07-d431-437d-b768-7fa9233ac068 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:13.125156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-049adf07-d431-437d-b768-7fa9233ac068 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:13.152133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-049adf07-d431-437d-b768-7fa9233ac068 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040800 Mar 08 19:51:13.152699 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 262/506] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Mar 8 19:51:13 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:13.208880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:13.209391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:13.215739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:13.216181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:13.216973 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:13.217402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:13.242176 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:51:13.312151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f45110f4-3540-49b2-8c57-b341e9fe3e83 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 204 len: 0 microversion: 2.20 time: 0.108190 Mar 08 19:51:13.312714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 245/507] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Mar 8 19:51:13 2022] DELETE /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:51:13.320944 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:13.321547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:13.327325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:13.327776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:13.328583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:13.329527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:13.463091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:13.470797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:13.472444 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:13.473580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9645a5de-4f3f-4858-9146-ab028f8eccb7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.156476 Mar 08 19:51:13.474136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 263/508] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:13 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:51:14.492985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:14.493587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:14.499713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:14.500158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:14.501614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:14.502050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:14.637533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:14.649511 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:14.653744 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:14.654903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-82cbbfae-f303-455a-b091-ffa6ac13f65f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1723 microversion: 2.20 time: 0.166292 Mar 08 19:51:14.655470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 246/509] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:14 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:51:15.674237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:15.674996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:15.682519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:15.683438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:15.685072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:15.685754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:15.750566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:15.759375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:15.760983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:15.762317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e670b572-bc8f-4c25-940b-85f803535e59 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 200 len: 1655 microversion: 2.20 time: 0.092667 Mar 08 19:51:15.762848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 264/510] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:15 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:15.891174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-1f13209b-41a7-4443-a2d2-9dfcd04e879f req-2df070a6-c91c-4daf-b6de-c16335d4f7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb7515f-c5d4-4330-a70a-c1835a5556c4", "name": "network-vif-deleted", "tag": "38ecd555-5c0f-44c2-850e-97cbfeea62d4"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:15.902804 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-1f13209b-41a7-4443-a2d2-9dfcd04e879f req-2df070a6-c91c-4daf-b6de-c16335d4f7ff service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:15.903578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-1f13209b-41a7-4443-a2d2-9dfcd04e879f req-2df070a6-c91c-4daf-b6de-c16335d4f7ff service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:15.917624 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-1f13209b-41a7-4443-a2d2-9dfcd04e879f req-2df070a6-c91c-4daf-b6de-c16335d4f7ff service nova] Creating event network-vif-deleted:38ecd555-5c0f-44c2-850e-97cbfeea62d4 for instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 on hv-cinder-83009 Mar 08 19:51:15.924703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-1f13209b-41a7-4443-a2d2-9dfcd04e879f req-2df070a6-c91c-4daf-b6de-c16335d4f7ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037389 Mar 08 19:51:15.927965 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 247/511] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:16.781757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:16.783636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:16.790567 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:16.791326 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:16.792110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:16.793304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:16.813755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] HTTP exception thrown: Instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 could not be found. Mar 08 19:51:16.814355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Returning 404 to user: Instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:51:16.815167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-88ec2bc3-48ce-4120-8610-30294aae49b0 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 404 len: 111 microversion: 2.20 time: 0.037292 Mar 08 19:51:16.815862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 265/512] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:16 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:51:16.824650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bb33c57e-05ce-41a1-a473-9b9d71a8640e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '.version_select at 0x7f070502fdc0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:16.843255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bb33c57e-05ce-41a1-a473-9b9d71a8640e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932018804" status: 204 len: 0 microversion: 2.20 time: 0.022799 Mar 08 19:51:16.843828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 248/513] 10.222.0.45 () {60 vars in 1261 bytes} [Tue Mar 8 19:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932018804 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 08 19:51:17.496184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c6bfc9b-2a66-4b3b-aa2f-0a88dc5de746 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'create', calling method: .version_select at 0x7f0704638af0>, body: {"keypair": {"name": "tempest-keypair-682982161"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:17.510834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-4c6bfc9b-2a66-4b3b-aa2f-0a88dc5de746 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:51:17.514980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-4c6bfc9b-2a66-4b3b-aa2f-0a88dc5de746 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for user df63dc8dd51a4afbb03e84060ace90ee and project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:51:17.760572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-4c6bfc9b-2a66-4b3b-aa2f-0a88dc5de746 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:51:17.764113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-4c6bfc9b-2a66-4b3b-aa2f-0a88dc5de746 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for user df63dc8dd51a4afbb03e84060ace90ee and project 2f8fc81146d843659f7b027db2238ff7. Resources: {'key_pairs'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:51:17.776996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4c6bfc9b-2a66-4b3b-aa2f-0a88dc5de746 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.285153 Mar 08 19:51:17.777580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 266/514] 10.222.0.45 () {62 vars in 1198 bytes} [Tue Mar 8 19:51:17 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 286 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:51:19.021269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-831749041", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f5b26d-7786-4d76-b026-0184c6ebc557"}], "security_groups": [{"name": "tempest-securitygroup--585006944"}], "key_name": "tempest-keypair-682982161", "user_data": "}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:19.120473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] validate_networks() for [('b3f5b26d-7786-4d76-b026-0184c6ebc557', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:51:19.474957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:51:19.475400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:51:19.475869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:51:19.476274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:51:19.476703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:51:19.485134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:19.485575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:19.486367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:19.486800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:19.503047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for project 2f8fc81146d843659f7b027db2238ff7. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:51:19.506833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Getting quotas for user df63dc8dd51a4afbb03e84060ace90ee and project 2f8fc81146d843659f7b027db2238ff7. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:51:19.518073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:51:19.520427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:51:19.566134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8bd63f3a-8c71-465c-8703-ee0ba0b4af26 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.549677 Mar 08 19:51:19.566771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 249/515] 10.222.0.45 () {62 vars in 1187 bytes} [Tue Mar 8 19:51:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 19:51:19.577821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b2b124c2-dd4c-4f09-b51b-88af66c15f81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:19.578671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b2b124c2-dd4c-4f09-b51b-88af66c15f81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:19.648768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b2b124c2-dd4c-4f09-b51b-88af66c15f81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:19.657413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b2b124c2-dd4c-4f09-b51b-88af66c15f81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:19.658938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b2b124c2-dd4c-4f09-b51b-88af66c15f81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:19.660111 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b2b124c2-dd4c-4f09-b51b-88af66c15f81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1280 microversion: 2.20 time: 0.086957 Mar 08 19:51:19.660736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 267/516] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:19 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:20.680031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:20.680460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:20.687197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:20.687654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:20.688482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:20.688921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:20.983965 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:20.992179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:20.993763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:20.994866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f2ce70c4-1ae5-4bd2-8988-e54e18f08977 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1338 microversion: 2.20 time: 0.320284 Mar 08 19:51:20.995420 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 250/517] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:20 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:22.013419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:22.014681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:22.022943 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:22.023941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:22.025288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:22.026056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:22.237488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:22.248374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:22.250062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:22.251497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3722e296-f72d-4bde-b072-9542e2509bfa tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1405 microversion: 2.20 time: 0.241896 Mar 08 19:51:22.256746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 268/518] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:22 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:22.274141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-0f65fac7-6559-4bd5-8b80-3506b18c130f req-6751e1e7-47c8-431d-a75d-31ee10c88885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29933d05-3536-4ba1-8676-36a83a073710", "tag": "4ac3b787-c699-4162-baaf-0b30eccf074d"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:22.293303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-0f65fac7-6559-4bd5-8b80-3506b18c130f req-6751e1e7-47c8-431d-a75d-31ee10c88885 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:22.293751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-0f65fac7-6559-4bd5-8b80-3506b18c130f req-6751e1e7-47c8-431d-a75d-31ee10c88885 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:22.311696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-0f65fac7-6559-4bd5-8b80-3506b18c130f req-6751e1e7-47c8-431d-a75d-31ee10c88885 service nova] Creating event network-changed:4ac3b787-c699-4162-baaf-0b30eccf074d for instance 29933d05-3536-4ba1-8676-36a83a073710 on hv-cinder-83009 Mar 08 19:51:22.317794 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-0f65fac7-6559-4bd5-8b80-3506b18c130f req-6751e1e7-47c8-431d-a75d-31ee10c88885 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051702 Mar 08 19:51:22.318828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 251/519] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:23.274358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:23.276059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:23.287171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:23.287889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:23.288899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:23.289338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:23.425227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:23.433762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:23.435491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:23.436826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d255c3b9-1417-4d90-bf27-9e32e47ce60a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1405 microversion: 2.20 time: 0.167699 Mar 08 19:51:23.448238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 269/520] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:23 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:51:24.456731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:24.457341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:24.463453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:24.463914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:24.464705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:24.465143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:24.593073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:24.601763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:24.603283 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:24.604401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-11877f0e-77a1-4448-bff5-4ea8bfd838e2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1405 microversion: 2.20 time: 0.153079 Mar 08 19:51:24.604961 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 252/521] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:24 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:24.698193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-708298792", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "networks": [{"uuid": "a3e9c780-e855-4db2-b241-a494e4a1b9ae"}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:24.748492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] validate_networks() for [('a3e9c780-e855-4db2-b241-a494e4a1b9ae', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:51:25.080593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:51:25.081014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:51:25.081493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:51:25.081892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:51:25.082294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:51:25.090715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:25.091151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:25.091937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:25.092392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:25.108069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Getting quotas for project f465b155dca1452a855efa3b5794a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:51:25.112537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Getting quotas for user f754cb584f49488a8f18919b1a40512b and project f465b155dca1452a855efa3b5794a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:51:25.123184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:51:25.125429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:51:25.169440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cab8298f-e426-4a61-824c-6edc7a20c894 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474972 Mar 08 19:51:25.170282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 270/522] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:51:25.180574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4cf4fa71-ae79-4ed0-a929-69eefe03d95c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:25.181265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4cf4fa71-ae79-4ed0-a929-69eefe03d95c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:25.230592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4cf4fa71-ae79-4ed0-a929-69eefe03d95c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:25.237871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4cf4fa71-ae79-4ed0-a929-69eefe03d95c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1218 microversion: 2.1 time: 0.061186 Mar 08 19:51:25.238586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 253/523] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:25 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:25.622117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:25.622719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:25.628765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:25.629216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:25.630060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:25.630488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:25.769846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:25.777481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:25.778965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:25.780038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5da5916f-0ad0-47d8-96c8-2999da5a6c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1405 microversion: 2.20 time: 0.161857 Mar 08 19:51:25.780614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 271/524] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:25 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:26.255548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:26.256255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:26.262458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:26.262972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:26.263798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:26.264433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:26.327321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:26.335516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c782f109-6ff6-473a-8eb3-ab47a75865d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1276 microversion: 2.1 time: 0.084467 Mar 08 19:51:26.336085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 254/525] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:26 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:26.799474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:26.800086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:26.807477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:26.807933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:26.808745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:26.809183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:26.953625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:26.961546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:26.963054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:26.964146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8532d611-f187-4aa0-a947-e9b501f883cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1405 microversion: 2.20 time: 0.169141 Mar 08 19:51:26.964738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 272/526] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:26 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:51:27.350082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-b9bb1d3b-2202-4f19-9d3e-3f50ae3eb3db req-ea2b0438-411f-49dd-89e5-ad7ab7c4a291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701be7a5-99ea-4571-94d3-b4fcd131f495", "tag": "f517b434-848c-4999-8f8b-d07045b2c225"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:27.352358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:27.353028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:27.359459 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:27.360066 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-b9bb1d3b-2202-4f19-9d3e-3f50ae3eb3db req-ea2b0438-411f-49dd-89e5-ad7ab7c4a291 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:27.360230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:27.360494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-b9bb1d3b-2202-4f19-9d3e-3f50ae3eb3db req-ea2b0438-411f-49dd-89e5-ad7ab7c4a291 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:27.362394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:27.363070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:27.374803 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-b9bb1d3b-2202-4f19-9d3e-3f50ae3eb3db req-ea2b0438-411f-49dd-89e5-ad7ab7c4a291 service nova] Creating event network-changed:f517b434-848c-4999-8f8b-d07045b2c225 for instance 701be7a5-99ea-4571-94d3-b4fcd131f495 on hv-cinder-83009 Mar 08 19:51:27.380247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-b9bb1d3b-2202-4f19-9d3e-3f50ae3eb3db req-ea2b0438-411f-49dd-89e5-ad7ab7c4a291 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033728 Mar 08 19:51:27.380967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 255/527] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:27.505898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:27.513181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d888503b-abe6-415b-9c68-96a0ee1d06b5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1318 microversion: 2.1 time: 0.165181 Mar 08 19:51:27.513736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 273/528] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:27 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:27.983258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:27.984012 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:27.990926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:27.991383 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:27.992166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:27.992626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:28.212231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:28.220835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:28.222425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:28.223738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-87078a11-dc44-4191-96bf-2907895dfafc tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1405 microversion: 2.20 time: 0.244911 Mar 08 19:51:28.228760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 256/529] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:27 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:28.530646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:28.531431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:28.538398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:28.538851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:28.539555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-2d800a54-58a9-4710-b39f-e93617fd200b req-67bb9fa1-85df-4581-9c9b-324d299ae94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29933d05-3536-4ba1-8676-36a83a073710", "name": "network-vif-plugged", "status": "completed", "tag": "4ac3b787-c699-4162-baaf-0b30eccf074d"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:28.540017 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:28.540296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:28.549323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-2d800a54-58a9-4710-b39f-e93617fd200b req-67bb9fa1-85df-4581-9c9b-324d299ae94a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:28.549763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-2d800a54-58a9-4710-b39f-e93617fd200b req-67bb9fa1-85df-4581-9c9b-324d299ae94a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:28.561387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-2d800a54-58a9-4710-b39f-e93617fd200b req-67bb9fa1-85df-4581-9c9b-324d299ae94a service nova] Creating event network-vif-plugged:4ac3b787-c699-4162-baaf-0b30eccf074d for instance 29933d05-3536-4ba1-8676-36a83a073710 on hv-cinder-83009 Mar 08 19:51:28.566978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-2d800a54-58a9-4710-b39f-e93617fd200b req-67bb9fa1-85df-4581-9c9b-324d299ae94a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031932 Mar 08 19:51:28.567737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 257/530] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:28.685142 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:28.693539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ac40fda7-39bc-4f54-bf5e-6ca4745774f4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1318 microversion: 2.1 time: 0.166821 Mar 08 19:51:28.694113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 274/531] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:28 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:29.241923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:29.242617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:29.248734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:29.249187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:29.249953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:29.250390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:29.387296 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:29.395848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:29.397520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:29.398605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0702980d-f053-4a7a-ad92-af76f4c7d7c5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1405 microversion: 2.20 time: 0.161077 Mar 08 19:51:29.399166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 258/532] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:29 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:29.710388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:29.710954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:29.717184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:29.717636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:29.718398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:29.718834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:29.847895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:29.855219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-60d96add-5fc1-4d38-85db-b5286d6b0658 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1318 microversion: 2.1 time: 0.148848 Mar 08 19:51:29.855809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 275/533] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:29 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:30.416552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:30.417756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:30.424010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:30.424507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:30.425279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:30.425713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:30.560124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:30.568507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:30.570017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:30.571166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-aaef2590-8777-47d9-8f27-9289ab256354 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1597 microversion: 2.20 time: 0.158899 Mar 08 19:51:30.571793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 259/534] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:51:30 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:51:30.589458 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fdbb7fe7-a1c1-42c9-92f3-ae19e3810441 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:30.589958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fdbb7fe7-a1c1-42c9-92f3-ae19e3810441 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:30.596797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdbb7fe7-a1c1-42c9-92f3-ae19e3810441 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:30.597244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdbb7fe7-a1c1-42c9-92f3-ae19e3810441 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:30.598026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdbb7fe7-a1c1-42c9-92f3-ae19e3810441 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:30.598457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdbb7fe7-a1c1-42c9-92f3-ae19e3810441 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:30.683863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fdbb7fe7-a1c1-42c9-92f3-ae19e3810441 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098322 Mar 08 19:51:30.684495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 276/535] 10.222.0.45 () {60 vars in 1315 bytes} [Tue Mar 8 19:51:30 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:51:30.872646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:30.873372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:30.880468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:30.881013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:30.881861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:30.882367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:31.408083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:31.415594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0c18beaf-4faf-4e5e-8b5c-69c3080ec9ab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1318 microversion: 2.1 time: 0.546887 Mar 08 19:51:31.416161 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 260/536] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:30 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:31.958599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-89c5355a-d690-40bb-8248-21635f16da27 req-77be061f-f3e7-4027-b27c-155f1affde55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29933d05-3536-4ba1-8676-36a83a073710", "tag": "4ac3b787-c699-4162-baaf-0b30eccf074d"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:31.966664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-89c5355a-d690-40bb-8248-21635f16da27 req-77be061f-f3e7-4027-b27c-155f1affde55 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:31.967110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-89c5355a-d690-40bb-8248-21635f16da27 req-77be061f-f3e7-4027-b27c-155f1affde55 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:31.978198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-89c5355a-d690-40bb-8248-21635f16da27 req-77be061f-f3e7-4027-b27c-155f1affde55 service nova] Creating event network-changed:4ac3b787-c699-4162-baaf-0b30eccf074d for instance 29933d05-3536-4ba1-8676-36a83a073710 on hv-cinder-83009 Mar 08 19:51:31.983319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-89c5355a-d690-40bb-8248-21635f16da27 req-77be061f-f3e7-4027-b27c-155f1affde55 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028804 Mar 08 19:51:31.983963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 277/537] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:32.191963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-471c1c7b-1293-4dcb-a7fa-175f7b25fe0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:32.192927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-471c1c7b-1293-4dcb-a7fa-175f7b25fe0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:32.198936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-471c1c7b-1293-4dcb-a7fa-175f7b25fe0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.199709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-471c1c7b-1293-4dcb-a7fa-175f7b25fe0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.200765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-471c1c7b-1293-4dcb-a7fa-175f7b25fe0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.201291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-471c1c7b-1293-4dcb-a7fa-175f7b25fe0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.231183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-471c1c7b-1293-4dcb-a7fa-175f7b25fe0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043126 Mar 08 19:51:32.231756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 261/538] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:51:32 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:51:32.300615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:32.301225 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:32.307182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.307631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.308420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.308853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.335903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:51:32.432793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-04d33208-f093-4fba-a20f-d9ef2a2ea092 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 204 len: 0 microversion: 2.1 time: 0.136339 Mar 08 19:51:32.432994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:32.433483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:32.433719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 278/539] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:51:32 2022] DELETE /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:51:32.441739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.442665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.443171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:32.443812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.443938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:32.444662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.450363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.450820 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.451607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.452033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.601474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:32.609788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ee597deb-268d-42e8-9c59-798ac5b5f1d3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1675 microversion: 2.1 time: 0.171629 Mar 08 19:51:32.612335 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 279/540] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:32 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:51:32.654252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:32.661964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7d48d4a8-414d-4d1e-919f-74d1d8ac0105 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1318 microversion: 2.1 time: 0.233563 Mar 08 19:51:32.662796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 262/541] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:32 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:32.802288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-bbb5dc30-5cfb-4ed3-bfab-7fdb3a0e447d req-472bebca-11ad-498e-8b85-0003b5fcd3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701be7a5-99ea-4571-94d3-b4fcd131f495", "name": "network-vif-plugged", "status": "completed", "tag": "f517b434-848c-4999-8f8b-d07045b2c225"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:32.811138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-bbb5dc30-5cfb-4ed3-bfab-7fdb3a0e447d req-472bebca-11ad-498e-8b85-0003b5fcd3e4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:32.811586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-bbb5dc30-5cfb-4ed3-bfab-7fdb3a0e447d req-472bebca-11ad-498e-8b85-0003b5fcd3e4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:32.821902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-bbb5dc30-5cfb-4ed3-bfab-7fdb3a0e447d req-472bebca-11ad-498e-8b85-0003b5fcd3e4 service nova] Creating event network-vif-plugged:f517b434-848c-4999-8f8b-d07045b2c225 for instance 701be7a5-99ea-4571-94d3-b4fcd131f495 on hv-cinder-83009 Mar 08 19:51:32.827099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-bbb5dc30-5cfb-4ed3-bfab-7fdb3a0e447d req-472bebca-11ad-498e-8b85-0003b5fcd3e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028755 Mar 08 19:51:32.827767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 280/542] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:33.627133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:33.627738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:33.634028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:33.634478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:33.635245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:33.635683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:33.679962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:33.680665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:33.687074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:33.687524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:33.688304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:33.688746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:33.766817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:33.774310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fbe220fd-4914-46c0-a9f3-d20938fb25ae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1675 microversion: 2.1 time: 0.151003 Mar 08 19:51:33.774966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 263/543] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:33 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:33.825640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:33.832790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e71986c2-282e-4411-b071-8b286666b12e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1318 microversion: 2.1 time: 0.157030 Mar 08 19:51:33.833340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 281/544] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:33 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:51:34.791156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:34.791754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:34.798579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:34.799021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:34.799775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:34.800201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:34.849442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:34.850044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:34.856305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:34.856765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:34.857530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:34.857959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:34.933613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:34.941460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0af06066-db0f-47d7-85b6-b8df8061d5db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1675 microversion: 2.1 time: 0.154390 Mar 08 19:51:34.942032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 264/545] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:34 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:34.988942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:34.996142 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4b57f5b5-d6a7-4f9b-9711-e7a9d00f3dc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1507 microversion: 2.1 time: 0.150609 Mar 08 19:51:34.996721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 282/546] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:34 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:51:35.893484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-0c5b6cbc-baa3-4f20-bd11-1309a93e4f1d req-b96b00bd-0b87-400b-b466-154ec78523d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b451d-e030-4691-965c-19224d84c9b4", "name": "network-vif-deleted", "tag": "deea1de1-999c-4b53-999a-016d7f51ba59"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:35.908841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-0c5b6cbc-baa3-4f20-bd11-1309a93e4f1d req-b96b00bd-0b87-400b-b466-154ec78523d3 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:35.909429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-0c5b6cbc-baa3-4f20-bd11-1309a93e4f1d req-b96b00bd-0b87-400b-b466-154ec78523d3 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:35.921565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-0c5b6cbc-baa3-4f20-bd11-1309a93e4f1d req-b96b00bd-0b87-400b-b466-154ec78523d3 service nova] Creating event network-vif-deleted:deea1de1-999c-4b53-999a-016d7f51ba59 for instance 477b451d-e030-4691-965c-19224d84c9b4 on hv-cinder-83009 Mar 08 19:51:35.933962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-0c5b6cbc-baa3-4f20-bd11-1309a93e4f1d req-b96b00bd-0b87-400b-b466-154ec78523d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043866 Mar 08 19:51:35.935389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 265/547] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:35.958432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:35.959197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:35.967307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:35.968101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:35.969209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:35.970590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:36.038241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:36.046819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bba55175-4d6d-4e27-8f24-d2f5612444cd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 200 len: 1322 microversion: 2.1 time: 0.091574 Mar 08 19:51:36.048594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 283/548] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:35 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 1322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:37.067385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:37.068098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:37.074627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:37.075072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:37.075856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:37.076344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:37.089833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Instance 477b451d-e030-4691-965c-19224d84c9b4 could not be found. Mar 08 19:51:37.090417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 404 to user: Instance 477b451d-e030-4691-965c-19224d84c9b4 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:51:37.091265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-92120384-c795-422d-a6b8-db2c0f414c6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 404 len: 111 microversion: 2.1 time: 0.029376 Mar 08 19:51:37.091815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 266/549] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:37 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:51:37.100992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e233d457-9c88-43a2-ae09-be0621b906b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '.version_select at 0x7f070461e040>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:37.120113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e233d457-9c88-43a2-ae09-be0621b906b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335905347" status: 202 len: 0 microversion: 2.1 time: 0.022919 Mar 08 19:51:37.120774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 284/550] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Mar 8 19:51:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335905347 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:51:38.011998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8b364e9c-5562-44fa-950e-dfbac73bf334 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'create', calling method: .version_select at 0x7f0704f51790>, body: {"keypair": {"name": "tempest-keypair-549474882"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:38.026553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-8b364e9c-5562-44fa-950e-dfbac73bf334 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:51:38.030924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-8b364e9c-5562-44fa-950e-dfbac73bf334 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for user 53cb58d77e454254a2ae77687df2c7fd and project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:51:38.295673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-8b364e9c-5562-44fa-950e-dfbac73bf334 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:51:38.299349 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-8b364e9c-5562-44fa-950e-dfbac73bf334 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for user 53cb58d77e454254a2ae77687df2c7fd and project b21199b1cdf9475b8db163893c789545. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:51:38.311928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8b364e9c-5562-44fa-950e-dfbac73bf334 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.303962 Mar 08 19:51:38.312562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 267/551] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 19:51:38 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:39.594061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-143665762", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac9a0f9f-89c1-4e71-af10-ae382be0f761"}], "security_groups": [{"name": "tempest-securitygroup--1476059034"}], "key_name": "tempest-keypair-549474882", "user_data": "}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:39.707490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] validate_networks() for [('ac9a0f9f-89c1-4e71-af10-ae382be0f761', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:51:40.071606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:51:40.072034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:51:40.072543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:51:40.072961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:51:40.073542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:51:40.082470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:40.082922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:40.083750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:40.084186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:40.100401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for project b21199b1cdf9475b8db163893c789545. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:51:40.104260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Getting quotas for user 53cb58d77e454254a2ae77687df2c7fd and project b21199b1cdf9475b8db163893c789545. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:51:40.116495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:51:40.118765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:51:40.165034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e5d4e1d8-fd3f-4968-a2e3-cf1bf57396f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575716 Mar 08 19:51:40.165671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 285/552] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:51:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:51:40.176809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-78bf4e5a-ac98-482f-a481-78157ce50fe6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:40.177421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-78bf4e5a-ac98-482f-a481-78157ce50fe6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:40.231297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-78bf4e5a-ac98-482f-a481-78157ce50fe6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:40.238647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-78bf4e5a-ac98-482f-a481-78157ce50fe6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1236 microversion: 2.1 time: 0.066768 Mar 08 19:51:40.239225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 268/553] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:51:41.255758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:41.257075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:41.265068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:41.265715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:41.267213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:41.267839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:41.332663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:41.340074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d1c7dc7c-c62f-435a-8b11-30535d828a51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1294 microversion: 2.1 time: 0.089127 Mar 08 19:51:41.340782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 286/554] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:51:42.359079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:42.360639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:42.375907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:42.376779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:42.377214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:42.377648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:42.575261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-fec093c5-fa17-408f-9343-9e0c7e99e75d req-949f9290-52a4-42da-9597-a9d311f5f2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb579508-9118-47e4-a758-8e9c83890f77", "tag": "a295e990-86a1-493f-840d-bbb1864b6780"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:42.587005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-fec093c5-fa17-408f-9343-9e0c7e99e75d req-949f9290-52a4-42da-9597-a9d311f5f2f2 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:42.587471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-fec093c5-fa17-408f-9343-9e0c7e99e75d req-949f9290-52a4-42da-9597-a9d311f5f2f2 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:42.604136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-fec093c5-fa17-408f-9343-9e0c7e99e75d req-949f9290-52a4-42da-9597-a9d311f5f2f2 service nova] Creating event network-changed:a295e990-86a1-493f-840d-bbb1864b6780 for instance fb579508-9118-47e4-a758-8e9c83890f77 on hv-cinder-83009 Mar 08 19:51:42.609617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-fec093c5-fa17-408f-9343-9e0c7e99e75d req-949f9290-52a4-42da-9597-a9d311f5f2f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040166 Mar 08 19:51:42.610449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 287/555] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:42.622459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:42.630254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d397aaaa-e3dd-4a31-8c27-0665dd6d7c5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1362 microversion: 2.1 time: 0.275059 Mar 08 19:51:42.630838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 269/556] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:51:43.647836 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:43.648554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:43.655053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:43.655483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:43.656274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:43.656727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:43.795339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:43.803406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4d4d0438-e8b7-47b7-961e-fd0328932830 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1362 microversion: 2.1 time: 0.159779 Mar 08 19:51:43.804005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 288/557] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:44.819700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:44.820789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:44.826995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:44.827448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:44.828222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:44.828690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:44.965871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:44.973182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-32551d18-d6c5-4794-b429-1c907fa39f30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1362 microversion: 2.1 time: 0.157384 Mar 08 19:51:44.973743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 270/558] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:45.989576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:45.990182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:45.996452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:45.996902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:45.997662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:45.998095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:46.128482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:46.135585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-26a0302e-7a98-4ba7-898a-560b88a0d00b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1362 microversion: 2.1 time: 0.149775 Mar 08 19:51:46.136143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 289/559] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:47.152364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:47.152975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:47.159245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:47.159693 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:47.160489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:47.161561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:47.290310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:47.297463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-69086984-ef50-43ef-adb7-26b1d09965e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1362 microversion: 2.1 time: 0.148974 Mar 08 19:51:47.298028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 271/560] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:48.315912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:48.316543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:48.323693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:48.324145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:48.324950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:48.325391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:48.455100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:48.462938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e58032b0-9968-42f8-b53a-db4b527e9ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1362 microversion: 2.1 time: 0.152283 Mar 08 19:51:48.463934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 290/561] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:48.657535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-7215ea35-f788-4bf8-8350-399e2d26dba2 req-9e8ea0f2-b6c5-4ddd-8202-3de186622511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb579508-9118-47e4-a758-8e9c83890f77", "name": "network-vif-plugged", "status": "completed", "tag": "a295e990-86a1-493f-840d-bbb1864b6780"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:48.667825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-7215ea35-f788-4bf8-8350-399e2d26dba2 req-9e8ea0f2-b6c5-4ddd-8202-3de186622511 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:48.668302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-7215ea35-f788-4bf8-8350-399e2d26dba2 req-9e8ea0f2-b6c5-4ddd-8202-3de186622511 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:48.679924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-7215ea35-f788-4bf8-8350-399e2d26dba2 req-9e8ea0f2-b6c5-4ddd-8202-3de186622511 service nova] Creating event network-vif-plugged:a295e990-86a1-493f-840d-bbb1864b6780 for instance fb579508-9118-47e4-a758-8e9c83890f77 on hv-cinder-83009 Mar 08 19:51:48.685040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-7215ea35-f788-4bf8-8350-399e2d26dba2 req-9e8ea0f2-b6c5-4ddd-8202-3de186622511 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031309 Mar 08 19:51:48.685619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 272/562] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:49.480241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:49.480877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:49.487306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:49.487767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:49.488579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:49.489058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:49.631260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:49.638440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d7b9d8b1-45e7-4a85-a652-954e98281c3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1362 microversion: 2.1 time: 0.162569 Mar 08 19:51:49.639000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 291/563] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:50.102226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2a69dd6-80fb-44e0-8d23-19e360c59fcd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f579b219-7674-4cd6-89c4-acb9dda14da4", "device": "/dev/sdb"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:50.103902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2a69dd6-80fb-44e0-8d23-19e360c59fcd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:50.110433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a69dd6-80fb-44e0-8d23-19e360c59fcd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:50.110861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a69dd6-80fb-44e0-8d23-19e360c59fcd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:50.111633 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a69dd6-80fb-44e0-8d23-19e360c59fcd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:50.112069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2a69dd6-80fb-44e0-8d23-19e360c59fcd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:50.345131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2a69dd6-80fb-44e0-8d23-19e360c59fcd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "POST /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246944 Mar 08 19:51:50.345807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 273/564] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:51:50 2022] POST /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:50.655087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:50.655627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:50.662285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:50.662733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:50.663497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:50.663959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:50.797392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:51:50.804506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b2913fda-22d9-4615-a157-604f7f8440a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1549 microversion: 2.1 time: 0.153229 Mar 08 19:51:50.805061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 292/565] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:51:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:51:50.820890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f12f8db9-7b3c-48de-bd0c-775ad2203bbe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:50.821461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f12f8db9-7b3c-48de-bd0c-775ad2203bbe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:50.827862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12f8db9-7b3c-48de-bd0c-775ad2203bbe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:50.828303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12f8db9-7b3c-48de-bd0c-775ad2203bbe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:50.829078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12f8db9-7b3c-48de-bd0c-775ad2203bbe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:50.829507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f12f8db9-7b3c-48de-bd0c-775ad2203bbe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:50.914617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f12f8db9-7b3c-48de-bd0c-775ad2203bbe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097892 Mar 08 19:51:50.915201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 274/566] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Mar 8 19:51:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:52.097879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-45fe4d5e-1f78-4a04-a11a-95b9ec957c76 req-8a21725f-765e-4298-afd5-9bedc0b0c85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb579508-9118-47e4-a758-8e9c83890f77", "tag": "a295e990-86a1-493f-840d-bbb1864b6780"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:52.106834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-45fe4d5e-1f78-4a04-a11a-95b9ec957c76 req-8a21725f-765e-4298-afd5-9bedc0b0c85e service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:52.107283 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-45fe4d5e-1f78-4a04-a11a-95b9ec957c76 req-8a21725f-765e-4298-afd5-9bedc0b0c85e service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:52.119736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-45fe4d5e-1f78-4a04-a11a-95b9ec957c76 req-8a21725f-765e-4298-afd5-9bedc0b0c85e service nova] Creating event network-changed:a295e990-86a1-493f-840d-bbb1864b6780 for instance fb579508-9118-47e4-a758-8e9c83890f77 on hv-cinder-83009 Mar 08 19:51:52.125094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-45fe4d5e-1f78-4a04-a11a-95b9ec957c76 req-8a21725f-765e-4298-afd5-9bedc0b0c85e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030750 Mar 08 19:51:52.125927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 293/567] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:53.609643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-636afe62-09cf-4875-997d-78aa21eacd42 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:51:53.610162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-636afe62-09cf-4875-997d-78aa21eacd42 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:53.616684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636afe62-09cf-4875-997d-78aa21eacd42 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:53.617133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636afe62-09cf-4875-997d-78aa21eacd42 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:53.617892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636afe62-09cf-4875-997d-78aa21eacd42 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:53.618327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636afe62-09cf-4875-997d-78aa21eacd42 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:53.639604 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-636afe62-09cf-4875-997d-78aa21eacd42 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/ips" status: 200 len: 151 microversion: 2.1 time: 0.034314 Mar 08 19:51:53.640146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 275/568] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:51:53 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/ips => generated 151 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:51:54.937895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ad6ca1b6-f96f-4c52-92ca-b33c34362e4a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea06f6a2-f16a-4013-bd71-5edc27edf454"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:51:54.939019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ad6ca1b6-f96f-4c52-92ca-b33c34362e4a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:51:54.945084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad6ca1b6-f96f-4c52-92ca-b33c34362e4a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:54.945544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad6ca1b6-f96f-4c52-92ca-b33c34362e4a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:54.946313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad6ca1b6-f96f-4c52-92ca-b33c34362e4a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:51:54.946780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ad6ca1b6-f96f-4c52-92ca-b33c34362e4a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:51:55.181773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ad6ca1b6-f96f-4c52-92ca-b33c34362e4a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248159 Mar 08 19:51:55.182375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 294/569] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:51:54 2022] POST /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:05.809539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea06f6a2-f16a-4013-bd71-5edc27edf454"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:05.810641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:05.816840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:05.817288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:05.818045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:05.818477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:05.891664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Invalid volume: volume ea06f6a2-f16a-4013-bd71-5edc27edf454 is already attached to instances: b37d3efc-2ed3-4421-8b7b-482ebff040b3 Mar 08 19:52:05.892249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 400 to user: Invalid volume: volume ea06f6a2-f16a-4013-bd71-5edc27edf454 is already attached to instances: b37d3efc-2ed3-4421-8b7b-482ebff040b3 {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:52:05.893103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f1588c4b-3088-4e87-95a2-7434042160f5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.087560 Mar 08 19:52:05.893632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 276/570] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:52:05 2022] POST /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments => generated 174 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:52:05.952070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:05.952663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:05.959188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:05.959572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:05.960879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:05.961309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:06.036909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lazy-loading 'services' on Instance uuid b37d3efc-2ed3-4421-8b7b-482ebff040b3 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:52:06.104392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0eb5bdc4-d1ed-47ed-9b80-917d3a32c7a0 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments/ea06f6a2-f16a-4013-bd71-5edc27edf454" status: 202 len: 0 microversion: 2.1 time: 0.156319 Mar 08 19:52:06.105042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 295/571] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 19:52:05 2022] DELETE /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments/ea06f6a2-f16a-4013-bd71-5edc27edf454 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:52:06.113333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-03d2447f-01a3-452f-a68d-37048b9b7205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:06.114230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-03d2447f-01a3-452f-a68d-37048b9b7205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:06.120630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-03d2447f-01a3-452f-a68d-37048b9b7205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:06.121079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-03d2447f-01a3-452f-a68d-37048b9b7205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:06.121854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-03d2447f-01a3-452f-a68d-37048b9b7205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:06.122285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-03d2447f-01a3-452f-a68d-37048b9b7205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:06.152355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-03d2447f-01a3-452f-a68d-37048b9b7205 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 Mar 08 19:52:06.152904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 277/572] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:52:06 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:07.165671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0a74c1d3-861b-46a1-9532-d9854c298432 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:07.166731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0a74c1d3-861b-46a1-9532-d9854c298432 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:07.172771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a74c1d3-861b-46a1-9532-d9854c298432 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:07.173212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a74c1d3-861b-46a1-9532-d9854c298432 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:07.173963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a74c1d3-861b-46a1-9532-d9854c298432 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:07.174391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a74c1d3-861b-46a1-9532-d9854c298432 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:07.202012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0a74c1d3-861b-46a1-9532-d9854c298432 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041958 Mar 08 19:52:07.202550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 296/573] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:52:07 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:08.214087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-df2abcee-71a8-4d98-a624-267e395b5709 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:08.215001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-df2abcee-71a8-4d98-a624-267e395b5709 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:08.221294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df2abcee-71a8-4d98-a624-267e395b5709 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:08.221739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df2abcee-71a8-4d98-a624-267e395b5709 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:08.222499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df2abcee-71a8-4d98-a624-267e395b5709 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:08.222931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df2abcee-71a8-4d98-a624-267e395b5709 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:08.258428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-df2abcee-71a8-4d98-a624-267e395b5709 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048753 Mar 08 19:52:08.258981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 278/574] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:52:08 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:09.270143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f9293c19-eae5-49e2-8429-a2360b826a7f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:09.270962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f9293c19-eae5-49e2-8429-a2360b826a7f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:09.277166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9293c19-eae5-49e2-8429-a2360b826a7f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:09.277632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9293c19-eae5-49e2-8429-a2360b826a7f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:09.278383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9293c19-eae5-49e2-8429-a2360b826a7f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:09.278808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9293c19-eae5-49e2-8429-a2360b826a7f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:09.307258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f9293c19-eae5-49e2-8429-a2360b826a7f tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041135 Mar 08 19:52:09.307807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 297/575] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:52:09 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:52:09.362620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:09.363141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:09.370013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:09.370461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:09.371221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:09.371656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:09.394557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:52:09.466409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0efb214c-31c6-4c4f-8765-dc75546d90a5 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 204 len: 0 microversion: 2.1 time: 0.107339 Mar 08 19:52:09.471049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 279/576] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:52:09 2022] DELETE /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:52:09.477701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:09.478492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:09.485340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:09.485796 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:09.486715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:09.487157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:09.639501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:09.650812 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d525e75b-2012-45ab-ac1e-543178e0e14a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1683 microversion: 2.1 time: 0.174229 Mar 08 19:52:09.655496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 298/577] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:09 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:52:10.665641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:10.666334 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:10.672733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:10.673231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:10.674004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:10.674439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:10.937412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:10.944942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e3dc322b-88bf-4d54-959a-b69539affe07 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1683 microversion: 2.1 time: 0.284318 Mar 08 19:52:10.945654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 280/578] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:10 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1683 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:11.962518 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:11.963095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:11.969265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:11.969929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:11.970804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:11.971257 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:12.174647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:12.184031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-49e44293-cec9-484f-9a30-987d5a7f9483 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 200 len: 1683 microversion: 2.1 time: 0.225514 Mar 08 19:52:12.184647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 299/579] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:11 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:12.444659 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-365ae062-e38a-4c00-ad2a-6b403bfb23f6 req-679fcbf1-684a-49d6-a641-e6fab60f18eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37d3efc-2ed3-4421-8b7b-482ebff040b3", "name": "network-vif-deleted", "tag": "8a12a54f-7ede-4f74-acbe-18594f4017ff"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:12.453132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-365ae062-e38a-4c00-ad2a-6b403bfb23f6 req-679fcbf1-684a-49d6-a641-e6fab60f18eb service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:12.453547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-365ae062-e38a-4c00-ad2a-6b403bfb23f6 req-679fcbf1-684a-49d6-a641-e6fab60f18eb service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:12.465302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-365ae062-e38a-4c00-ad2a-6b403bfb23f6 req-679fcbf1-684a-49d6-a641-e6fab60f18eb service nova] Creating event network-vif-deleted:8a12a54f-7ede-4f74-acbe-18594f4017ff for instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 on hv-cinder-83009 Mar 08 19:52:12.470036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-365ae062-e38a-4c00-ad2a-6b403bfb23f6 req-679fcbf1-684a-49d6-a641-e6fab60f18eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029008 Mar 08 19:52:12.472442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 281/580] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:12.892467 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:12.893233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:12.899344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:12.900511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:12.901319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:12.901750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:12.998779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lazy-loading 'services' on Instance uuid 701be7a5-99ea-4571-94d3-b4fcd131f495 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:52:13.068775 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6d514c29-a401-47e8-b5ea-a83341fcbf97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "DELETE /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495/os-volume_attachments/f579b219-7674-4cd6-89c4-acb9dda14da4" status: 202 len: 0 microversion: 2.1 time: 0.180167 Mar 08 19:52:13.069392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 300/581] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 19:52:12 2022] DELETE /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495/os-volume_attachments/f579b219-7674-4cd6-89c4-acb9dda14da4 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:52:13.202477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:13.203300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:13.209270 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:13.209712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:13.210468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:13.210896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:13.223644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 could not be found. Mar 08 19:52:13.224223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:52:13.225052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5bbf0764-6d1c-46c5-9458-cf69a6bc35b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 404 len: 111 microversion: 2.1 time: 0.026838 Mar 08 19:52:13.225581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 282/582] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:13 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:52:13.234366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6e8503a3-79b9-4a5f-9ed3-133a2e2fc2d8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '.version_select at 0x7f070461e040>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:13.253132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6e8503a3-79b9-4a5f-9ed3-133a2e2fc2d8 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766152570" status: 202 len: 0 microversion: 2.1 time: 0.022647 Mar 08 19:52:13.253603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 301/583] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Mar 8 19:52:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766152570 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:52:13.892259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0798cab9-152b-4697-8392-9d61854755c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: .version_select at 0x7f0704edaaf0>, body: {"keypair": {"name": "tempest-keypair-1008730207"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:13.906825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-0798cab9-152b-4697-8392-9d61854755c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:52:13.910577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-0798cab9-152b-4697-8392-9d61854755c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:52:14.084920 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-0798cab9-152b-4697-8392-9d61854755c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:52:14.089470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-0798cab9-152b-4697-8392-9d61854755c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:52:14.102658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0798cab9-152b-4697-8392-9d61854755c3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.214529 Mar 08 19:52:14.103819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 283/584] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 19:52:13 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:14.194628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:14.195413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:14.202183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:14.202717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:14.203505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:14.203959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:14.230708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:52:14.315360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-67c2df72-4176-4b9a-b50f-71c9f81bed7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "DELETE /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 204 len: 0 microversion: 2.1 time: 0.125218 Mar 08 19:52:14.316108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 302/585] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:52:14 2022] DELETE /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:52:14.324810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:14.325508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:14.331331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:14.331780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:14.332573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:14.333192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:14.597751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:14.605573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f4897481-9b46-4526-9c85-80606caff8d1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1513 microversion: 2.1 time: 0.285110 Mar 08 19:52:14.606284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 284/586] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:14 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:52:15.549294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1824918143", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dfea349b-6bfd-41c2-92c4-062cebf33ab6"}], "security_groups": [{"name": "tempest-securitygroup--1647331878"}], "key_name": "tempest-keypair-1008730207", "user_data": "}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:15.622884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:15.623500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:15.629766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:15.630220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:15.631000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:15.631445 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:15.647059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] validate_networks() for [('dfea349b-6bfd-41c2-92c4-062cebf33ab6', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:52:15.768028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:15.775522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8b0b7a5f-f5f2-4d65-9af2-3d1a0cd1dac9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1513 microversion: 2.1 time: 0.156544 Mar 08 19:52:15.776194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 285/587] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:15 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:52:16.009824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:52:16.010376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:52:16.010850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:52:16.011261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:52:16.011686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:52:16.021155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:16.021596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:16.022408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:16.022827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:16.039905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:52:16.043899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Getting quotas for user b654ac865d634424843f844edc8a12ba and project 94f11a138e0849f79d37eff5a59cf1cb. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:52:16.054677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:52:16.057113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:52:16.102798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7a08ddf5-11d4-44d4-98b6-c3a682a09cef tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558117 Mar 08 19:52:16.103447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 303/588] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:52:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:52:16.113744 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6c834337-0032-4ac7-8d5d-86cd70afd5f3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:16.114598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6c834337-0032-4ac7-8d5d-86cd70afd5f3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:16.169395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6c834337-0032-4ac7-8d5d-86cd70afd5f3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:16.176086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6c834337-0032-4ac7-8d5d-86cd70afd5f3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1242 microversion: 2.1 time: 0.066396 Mar 08 19:52:16.176688 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 286/589] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:16 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:16.702247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-8cdc1265-a056-4361-a505-e212c534fad0 req-eb32b0f3-f59b-4710-8fb0-23512a19790e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701be7a5-99ea-4571-94d3-b4fcd131f495", "name": "network-vif-deleted", "tag": "f517b434-848c-4999-8f8b-d07045b2c225"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:16.712808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-8cdc1265-a056-4361-a505-e212c534fad0 req-eb32b0f3-f59b-4710-8fb0-23512a19790e service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:16.713426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-8cdc1265-a056-4361-a505-e212c534fad0 req-eb32b0f3-f59b-4710-8fb0-23512a19790e service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:16.725208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-8cdc1265-a056-4361-a505-e212c534fad0 req-eb32b0f3-f59b-4710-8fb0-23512a19790e service nova] Creating event network-vif-deleted:f517b434-848c-4999-8f8b-d07045b2c225 for instance 701be7a5-99ea-4571-94d3-b4fcd131f495 on hv-cinder-83009 Mar 08 19:52:16.731994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-8cdc1265-a056-4361-a505-e212c534fad0 req-eb32b0f3-f59b-4710-8fb0-23512a19790e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033527 Mar 08 19:52:16.731994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 304/590] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:16.795533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:16.796660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:16.803689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:16.804142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:16.804950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:16.805384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:16.870066 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:16.877390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-32192744-ea03-4e36-9c79-8f10c299b44f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 200 len: 1303 microversion: 2.1 time: 0.088502 Mar 08 19:52:16.877958 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 287/591] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:16 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:17.197320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:17.198302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:17.205613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:17.206063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:17.206826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:17.207332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:17.279028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:17.290076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-943b873c-bdd9-4672-bece-676991695ddf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1302 microversion: 2.1 time: 0.099248 Mar 08 19:52:17.291432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 305/592] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:17 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:17.894310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:17.895014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: 701be7a5-99ea-4571-94d3-b4fcd131f495] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:17.902429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:17.902881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:17.903664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:17.904089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:17.918840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] HTTP exception thrown: Instance 701be7a5-99ea-4571-94d3-b4fcd131f495 could not be found. Mar 08 19:52:17.919419 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Returning 404 to user: Instance 701be7a5-99ea-4571-94d3-b4fcd131f495 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:52:17.920269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-147c2517-b51a-467e-bf21-2cf2a14c833c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495" status: 404 len: 111 microversion: 2.1 time: 0.030190 Mar 08 19:52:17.920838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 288/593] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:17 2022] GET /compute/v2.1/servers/701be7a5-99ea-4571-94d3-b4fcd131f495 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:52:18.307837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:18.308480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:18.314707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:18.315158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:18.315939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:18.316414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:18.461579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:18.469666 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4449b49a-c0b0-414c-ba75-77b9e7d2507b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.166199 Mar 08 19:52:18.470250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 306/594] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:18 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:18.746051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-928e4b27-a689-42ab-9903-477dc615ddda req-7070bc51-2f81-4305-86ab-ec9f8c257e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b992e6-93af-4c5c-8e4f-8004842e455e", "tag": "4f48c927-0691-47e3-8433-ee3ab38d9048"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:18.753970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-928e4b27-a689-42ab-9903-477dc615ddda req-7070bc51-2f81-4305-86ab-ec9f8c257e91 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:18.754415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-928e4b27-a689-42ab-9903-477dc615ddda req-7070bc51-2f81-4305-86ab-ec9f8c257e91 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:18.767207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-928e4b27-a689-42ab-9903-477dc615ddda req-7070bc51-2f81-4305-86ab-ec9f8c257e91 service nova] Creating event network-changed:4f48c927-0691-47e3-8433-ee3ab38d9048 for instance 30b992e6-93af-4c5c-8e4f-8004842e455e on hv-cinder-83009 Mar 08 19:52:18.771866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-928e4b27-a689-42ab-9903-477dc615ddda req-7070bc51-2f81-4305-86ab-ec9f8c257e91 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029522 Mar 08 19:52:18.772449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 289/595] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:19.487185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:19.487791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:19.494566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:19.495010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:19.495771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:19.496202 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:19.634966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:19.642329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b0aa8101-0cf2-4ac9-a7bc-83b0f4136ebf tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.159268 Mar 08 19:52:19.642908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 307/596] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:19 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:20.659858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:20.660579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:20.666918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:20.667371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:20.668143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:20.668602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:20.798783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:20.806431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-db80f4f9-a47a-4392-83e1-b36d850a104b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.150657 Mar 08 19:52:20.806988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 290/597] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:20 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:21.823384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:21.823982 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:21.830233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:21.830674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:21.831433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:21.831858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:21.960316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:21.968144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6a179eec-4854-4281-87ed-263b229e4f80 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.149081 Mar 08 19:52:21.968745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 308/598] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:21 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:22.545098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1aca7a6f-3d65-4c96-bbaa-3c4cc45acc72 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:22.545650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1aca7a6f-3d65-4c96-bbaa-3c4cc45acc72 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:22.552265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1aca7a6f-3d65-4c96-bbaa-3c4cc45acc72 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:22.552744 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1aca7a6f-3d65-4c96-bbaa-3c4cc45acc72 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:22.553523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1aca7a6f-3d65-4c96-bbaa-3c4cc45acc72 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:22.554290 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1aca7a6f-3d65-4c96-bbaa-3c4cc45acc72 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:22.578241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1aca7a6f-3d65-4c96-bbaa-3c4cc45acc72 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/ips" status: 200 len: 151 microversion: 2.20 time: 0.036876 Mar 08 19:52:22.578606 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 291/599] 10.222.0.45 () {60 vars in 1288 bytes} [Tue Mar 8 19:52:22 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:52:22.984935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:22.985489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:22.991636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:22.992079 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:22.992891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:22.993353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:23.125317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:23.132552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-753577b7-6e2a-452d-b55d-8b86f50028b3 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.151527 Mar 08 19:52:23.133120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 309/600] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:22 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:24.150711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:24.151326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:24.158926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:24.159366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:24.160839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:24.160839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:24.205869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:24.207119 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:24.214955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:24.215718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:24.216761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:24.217408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:24.249061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lazy-loading 'flavor' on Instance uuid 08ec178e-8ba4-4606-8aa8-131038fc027e {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:52:24.298474 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:24.306696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0d0d810a-bbf4-4195-87e9-6001b65a64dd tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.160408 Mar 08 19:52:24.307362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 292/601] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:24 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:24.327652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f858ae39-9fac-41b5-a094-80a3ef4b19c5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "POST /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e/action" status: 202 len: 0 microversion: 2.1 time: 0.129614 Mar 08 19:52:24.328228 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 310/602] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:52:24 2022] POST /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:52:24.336188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:24.336858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:24.345500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:24.346058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:24.347308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:24.348125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:24.492994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:24.500816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1550b44e-10ba-4e30-8c46-642406fbc052 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.168349 Mar 08 19:52:24.501388 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 293/603] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:25.325264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:25.325957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:25.331893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:25.332376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:25.333136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:25.333569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:25.472304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:25.479834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7003aaa9-8321-4626-b4cc-f06310a5ba4b tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.159798 Mar 08 19:52:25.480535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 311/604] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:25 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:25.520760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:25.521362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:25.527806 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:25.528257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:25.529343 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:25.529953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:25.672450 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:25.680189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c6d3c8c9-f511-4f99-8b0f-0f638a27cff9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.163830 Mar 08 19:52:25.681754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 294/605] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:25.689509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-472354419", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "networks": [{"uuid": "a3e9c780-e855-4db2-b241-a494e4a1b9ae"}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:25.737301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] validate_networks() for [('a3e9c780-e855-4db2-b241-a494e4a1b9ae', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:52:26.294025 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:52:26.294450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:52:26.294923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:52:26.295331 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:52:26.295744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:52:26.304150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:26.304630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:26.305423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:26.305860 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:26.323236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Getting quotas for project f465b155dca1452a855efa3b5794a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:52:26.327075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Getting quotas for user f754cb584f49488a8f18919b1a40512b and project f465b155dca1452a855efa3b5794a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:52:26.338036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:52:26.340222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:52:26.382941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-33399518-fab9-4698-a541-223942fa32b2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697123 Mar 08 19:52:26.383579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 312/606] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 19:52:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:52:26.393745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e62bda1a-6e29-4c90-9615-2e5ef461220d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:26.394355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e62bda1a-6e29-4c90-9615-2e5ef461220d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:26.445190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e62bda1a-6e29-4c90-9615-2e5ef461220d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:26.451982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e62bda1a-6e29-4c90-9615-2e5ef461220d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1218 microversion: 2.1 time: 0.062000 Mar 08 19:52:26.452596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 295/607] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:26 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:26.496125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:26.496766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:26.502675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:26.503132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:26.504195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:26.504776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:26.637316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:26.644547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9e95ef3c-af4a-4dfe-a23f-d787f8506223 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.152295 Mar 08 19:52:26.645285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 313/608] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:26 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:26.697772 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:26.698375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:26.704922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:26.705378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:26.706149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:26.706583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:26.860379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:26.867757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2f2bca51-9073-4411-87b2-60551121cf46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.174448 Mar 08 19:52:26.868328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 296/609] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:27.016023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:27.016536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:27.022399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.022850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.023618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.024056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.047564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lazy-loading 'flavor' on Instance uuid 29933d05-3536-4ba1-8676-36a83a073710 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:52:27.309206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e4583dab-d668-4979-a373-cf1daa78407b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/action" status: 202 len: 0 microversion: 2.20 time: 0.296852 Mar 08 19:52:27.310263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 314/610] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Mar 8 19:52:27 2022] POST /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:52:27.321709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:27.322480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:27.344034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.345289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.347429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.348496 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.470049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:27.471335 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:27.478598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.479351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.480388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.481062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.551002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:27.558163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8232654d-2ceb-4fa9-b055-2d918eeb7523 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1276 microversion: 2.1 time: 0.092934 Mar 08 19:52:27.558721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 315/611] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:27 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:52:27.610069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-ee7040d2-e10e-44c9-96cb-aa95b86cd841 req-10265621-69b3-450e-b7fb-3618ec157d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b992e6-93af-4c5c-8e4f-8004842e455e", "name": "network-vif-plugged", "status": "completed", "tag": "4f48c927-0691-47e3-8433-ee3ab38d9048"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:27.619353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ee7040d2-e10e-44c9-96cb-aa95b86cd841 req-10265621-69b3-450e-b7fb-3618ec157d58 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.619848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ee7040d2-e10e-44c9-96cb-aa95b86cd841 req-10265621-69b3-450e-b7fb-3618ec157d58 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.633547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-ee7040d2-e10e-44c9-96cb-aa95b86cd841 req-10265621-69b3-450e-b7fb-3618ec157d58 service nova] Creating event network-vif-plugged:4f48c927-0691-47e3-8433-ee3ab38d9048 for instance 30b992e6-93af-4c5c-8e4f-8004842e455e on hv-cinder-83009 Mar 08 19:52:27.638577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-ee7040d2-e10e-44c9-96cb-aa95b86cd841 req-10265621-69b3-450e-b7fb-3618ec157d58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033257 Mar 08 19:52:27.639446 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 316/612] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:52:27.641423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:27.650217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:27.651746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:27.652964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9b6ff508-7ca1-433a-b5a1-1c7e3b196c6a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.338537 Mar 08 19:52:27.662520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 297/613] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:27 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:27.662637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:27.662793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:27.669910 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.670349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.671158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.671589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.817323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:27.825941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b0926f66-bf01-45c0-96f9-f84220476012 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.168674 Mar 08 19:52:27.826699 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 317/614] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:27 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:27.884654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:27.885289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:27.891430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.891876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:27.892682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:27.893117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:28.388655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:28.396446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4e4a1a15-98ee-49c0-9367-2b56d7dfd4af tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.516163 Mar 08 19:52:28.397494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 298/615] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:27 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:28.574931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:28.575550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:28.581875 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:28.582316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:28.583085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:28.583525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:28.674881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:28.675752 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:28.682280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:28.682848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:28.683732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:28.684273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:28.719061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:28.726394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a44a67d7-bc8e-410f-b474-1bf379a13bbb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.155417 Mar 08 19:52:28.726981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 318/616] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:28 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:28.842920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:28.843665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:28.849526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:28.849968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:28.850718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:28.851145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:28.955900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:28.965556 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:28.967178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:28.968452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2ca98011-e226-4c1a-915d-e3ad27793905 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.297454 Mar 08 19:52:28.969091 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 299/617] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:28 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:52:28.987556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:28.994893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d3afc377-b07e-42fd-875d-be0a43ec8833 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1368 microversion: 2.1 time: 0.155825 Mar 08 19:52:28.995539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 319/618] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:28 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:52:29.260155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-22dcddaf-29e3-4058-949f-612cea77969c req-c16a88d9-1175-466b-83e4-4efe5df06154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf15cfb8-7c73-418b-b268-1fc064fc717f", "tag": "b795f2a0-a5c0-454f-8fbe-956e41ba2c9c"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:29.268414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-22dcddaf-29e3-4058-949f-612cea77969c req-c16a88d9-1175-466b-83e4-4efe5df06154 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:29.268864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-22dcddaf-29e3-4058-949f-612cea77969c req-c16a88d9-1175-466b-83e4-4efe5df06154 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:29.281282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-22dcddaf-29e3-4058-949f-612cea77969c req-c16a88d9-1175-466b-83e4-4efe5df06154 service nova] Creating event network-changed:b795f2a0-a5c0-454f-8fbe-956e41ba2c9c for instance cf15cfb8-7c73-418b-b268-1fc064fc717f on hv-cinder-83009 Mar 08 19:52:29.286001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-22dcddaf-29e3-4058-949f-612cea77969c req-c16a88d9-1175-466b-83e4-4efe5df06154 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030231 Mar 08 19:52:29.286859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 300/619] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:29.414417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:29.415118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:29.421088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:29.421637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:29.422483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:29.422991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:29.562151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:29.569575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ec03da79-cff4-4731-81fc-1816523e5fb3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.159286 Mar 08 19:52:29.570151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 320/620] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:29.744801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:29.745607 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:29.751551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:29.752041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:29.752825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:29.753252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:29.948513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:29.955651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6e99b10a-2a61-483f-8d1d-02236a743bd7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.215719 Mar 08 19:52:29.956214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 301/621] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:29 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:30.012222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:30.012886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:30.018792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.019462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.020442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.021036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.094183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:30.094786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:30.100640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.101091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.101868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.102305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.239670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:30.248042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:30.249617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:30.250772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a559fe3e-b5d0-4a26-a54e-a148967df405 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.267021 Mar 08 19:52:30.251321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 321/622] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:29 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:30.253988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:30.261774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-728888e4-cfed-4f3b-851d-07c21443d0d9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1558 microversion: 2.1 time: 0.253983 Mar 08 19:52:30.262716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 302/623] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:30 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1558 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:52:30.277847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-20f76bb5-7ade-4626-b706-b170aed729b6 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:30.278336 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-20f76bb5-7ade-4626-b706-b170aed729b6 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:30.284064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20f76bb5-7ade-4626-b706-b170aed729b6 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.284549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20f76bb5-7ade-4626-b706-b170aed729b6 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.285313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20f76bb5-7ade-4626-b706-b170aed729b6 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.285743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20f76bb5-7ade-4626-b706-b170aed729b6 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.365913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-20f76bb5-7ade-4626-b706-b170aed729b6 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091847 Mar 08 19:52:30.366534 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 322/624] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Mar 8 19:52:30 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:30.587735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:30.588498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:30.594396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.594937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.595711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.596149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.735951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:30.744580 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a6ac9f6c-d348-4ad6-8ed9-69d9e7bd4508 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.161239 Mar 08 19:52:30.745316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 303/625] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:30 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:30.972489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:30.973245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:30.979946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.980425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:30.981193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:30.981624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:31.239915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:31.250401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d17a8fea-9dcc-4400-afa0-0ff0dbb07899 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.281747 Mar 08 19:52:31.251740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 323/626] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:30 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:31.269580 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:31.270414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:31.278417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:31.278947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:31.279936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:31.280783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:31.418953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:31.427430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:31.429223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:31.430551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fea8edec-5f7d-40a7-8dfe-5d56d5267b40 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.165584 Mar 08 19:52:31.431828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 304/627] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:31 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:31.465450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-8fdf0280-54c3-404b-9f64-444a8503aff2 req-855d2858-8d97-43f4-82c2-7ba7b0c30a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b992e6-93af-4c5c-8e4f-8004842e455e", "tag": "4f48c927-0691-47e3-8433-ee3ab38d9048"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:31.473457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-8fdf0280-54c3-404b-9f64-444a8503aff2 req-855d2858-8d97-43f4-82c2-7ba7b0c30a3e service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:31.474189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-8fdf0280-54c3-404b-9f64-444a8503aff2 req-855d2858-8d97-43f4-82c2-7ba7b0c30a3e service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:31.485238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-8fdf0280-54c3-404b-9f64-444a8503aff2 req-855d2858-8d97-43f4-82c2-7ba7b0c30a3e service nova] Creating event network-changed:4f48c927-0691-47e3-8433-ee3ab38d9048 for instance 30b992e6-93af-4c5c-8e4f-8004842e455e on hv-cinder-83009 Mar 08 19:52:31.490685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-8fdf0280-54c3-404b-9f64-444a8503aff2 req-855d2858-8d97-43f4-82c2-7ba7b0c30a3e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028760 Mar 08 19:52:31.492452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 324/628] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:31.762327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:31.763588 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:31.769534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:31.769983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:31.771068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:31.771194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:31.989674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:31.997710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-735fc00f-00c1-4f17-a255-fc1f8c45eb71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.239781 Mar 08 19:52:31.998401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 305/629] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:31 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:32.267974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:32.268714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:32.274720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:32.275175 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:32.275954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:32.276415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:32.416223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:32.423693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6157c622-2ceb-44b7-8385-505e12ec7e65 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.160433 Mar 08 19:52:32.424263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 325/630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:32 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:32.450107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:32.450715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:32.457215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:32.457664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:32.458506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:32.458943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:32.604642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:32.612669 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:32.614302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:32.615530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c2e8775b-2c22-41ee-9934-05d696fc2489 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.169948 Mar 08 19:52:32.616171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 306/631] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:32 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:33.015004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:33.015609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:33.021403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:33.021848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:33.022603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:33.023029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:33.153583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:33.160970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9aee0801-ba56-4e6f-9ecd-47d98b5ed7f2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.149756 Mar 08 19:52:33.161809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 326/632] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:33 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:33.440946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:33.441557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:33.447337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:33.447843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:33.449252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:33.449698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:33.598661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:33.606807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d3383e19-cf6b-44b3-8b1f-84bd07a4ac52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.169748 Mar 08 19:52:33.607367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 307/633] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:33 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:33.634359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:33.634958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:33.641094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:33.641540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:33.642291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:33.642729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:33.775642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:33.783266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:33.784779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:33.785897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6845318a-9511-4320-95ac-32db4d832381 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.155547 Mar 08 19:52:33.786721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 327/634] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:33 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:34.178754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:34.179368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:34.185347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:34.185797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:34.186562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:34.186997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:34.319081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:34.326321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d980e978-cead-4866-b604-920d5389e800 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.151409 Mar 08 19:52:34.326881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 308/635] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:34.623875 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:34.624525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:34.630319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:34.630762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:34.631513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:34.631938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:34.760582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:34.767759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-41ccdc1d-5651-4143-bb95-45f35a529a99 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.147676 Mar 08 19:52:34.768355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 328/636] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:34 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:34.803996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:34.804616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:34.810931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:34.811372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:34.812123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:34.812584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:34.940415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:34.948628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:34.950121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:34.951238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a5940e47-634f-4b42-a788-26bd056ee026 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.151108 Mar 08 19:52:34.951788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 309/637] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:34 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:35.342896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:35.343505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:35.349288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:35.349733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:35.350488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:35.350923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:35.489751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:35.497880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f1eb4f34-d9dc-49a9-9219-5a56cbef9d72 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.158776 Mar 08 19:52:35.498456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 329/638] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:35.576626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-651120d1-04af-4af4-8b35-5aa2f720aa1d req-621f515b-d2dd-4e00-9510-55310abef465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf15cfb8-7c73-418b-b268-1fc064fc717f", "name": "network-vif-plugged", "status": "completed", "tag": "b795f2a0-a5c0-454f-8fbe-956e41ba2c9c"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:35.584658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-651120d1-04af-4af4-8b35-5aa2f720aa1d req-621f515b-d2dd-4e00-9510-55310abef465 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:35.585005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-651120d1-04af-4af4-8b35-5aa2f720aa1d req-621f515b-d2dd-4e00-9510-55310abef465 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:35.596279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-651120d1-04af-4af4-8b35-5aa2f720aa1d req-621f515b-d2dd-4e00-9510-55310abef465 service nova] Creating event network-vif-plugged:b795f2a0-a5c0-454f-8fbe-956e41ba2c9c for instance cf15cfb8-7c73-418b-b268-1fc064fc717f on hv-cinder-83009 Mar 08 19:52:35.600871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-651120d1-04af-4af4-8b35-5aa2f720aa1d req-621f515b-d2dd-4e00-9510-55310abef465 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027891 Mar 08 19:52:35.601658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 310/639] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:35.788914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:35.789523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:35.796223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:35.796705 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:35.797479 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:35.797908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:35.927046 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:35.934414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d2b64273-b5e0-4845-8061-627741f71c0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.149569 Mar 08 19:52:35.934981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 330/640] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:35 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:35.970092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:35.970779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:35.976723 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:35.977167 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:35.978574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:35.978998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:36.108444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:36.116572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:36.118090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:36.119261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e6645823-d448-4010-ada5-418a127c9894 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.153802 Mar 08 19:52:36.119807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 311/641] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:35 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:36.515174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:36.515697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:36.521488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:36.521931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:36.522684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:36.523112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:36.654015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:36.661519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-04880daf-71a8-4707-ad81-519bda8fa0a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.150102 Mar 08 19:52:36.662076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 331/642] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:36.951138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:36.951748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:36.957470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:36.957928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:36.958699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:36.959136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:37.086983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:37.094866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ac525b46-b3f7-4220-8309-78bc2ad56ee6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1318 microversion: 2.1 time: 0.147802 Mar 08 19:52:37.095622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 312/643] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:36 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:37.137184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:37.137783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:37.144305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:37.144767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:37.145529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:37.145959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:37.280278 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:37.288231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:37.289766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:37.291545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e45bdba5-d87f-4f5b-83da-b4d2b19a8a93 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.158257 Mar 08 19:52:37.292108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 332/644] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:37 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:37.678263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:37.678867 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:37.685319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:37.685766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:37.686523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:37.686953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:37.822732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:37.830131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-50881fc3-24d5-4ddd-a738-2c5dae7d06f1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.155674 Mar 08 19:52:37.830745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 313/645] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:38.112511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:38.113129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:38.119290 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.119742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.120559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.120999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.257358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:38.265485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-eb19f6b4-b6e0-4293-a5da-03b51255a168 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1507 microversion: 2.1 time: 0.156939 Mar 08 19:52:38.266056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 333/646] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:38 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:38.282240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-08f546d6-07ca-4ae3-af8e-b67b306f90d2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1c34a5f-2afa-4c67-8a57-36b6f29f17a2", "device": "/dev/sdb"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:38.283417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-08f546d6-07ca-4ae3-af8e-b67b306f90d2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:38.289924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08f546d6-07ca-4ae3-af8e-b67b306f90d2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.290378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08f546d6-07ca-4ae3-af8e-b67b306f90d2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.291157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08f546d6-07ca-4ae3-af8e-b67b306f90d2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.291577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08f546d6-07ca-4ae3-af8e-b67b306f90d2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.309370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:38.309979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:38.315640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.316091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.316898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.317342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.455342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:38.464170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:38.466235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:38.467143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-df23e143-f9d3-4f0e-bf59-9750a0270082 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.161641 Mar 08 19:52:38.467904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 334/647] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:38 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:52:38.534194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-08f546d6-07ca-4ae3-af8e-b67b306f90d2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "POST /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255590 Mar 08 19:52:38.534791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 314/648] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:52:38 2022] POST /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:52:38.845906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:38.846506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:38.852195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.853306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.854064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:38.854490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:38.988398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:38.995568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c6491fce-5b62-44b3-ac83-5bef722e724f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.153443 Mar 08 19:52:38.996115 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 335/649] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:39.487828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:39.488545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:39.495029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:39.495473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:39.496229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:39.496679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:39.634697 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:39.642641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:39.644156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:39.645354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e7219874-ca81-4aa7-8289-d2a9e268afa8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.162354 Mar 08 19:52:39.645918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 315/650] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:39 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:40.012684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:40.013314 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:40.019492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:40.019945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:40.020744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:40.021186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:40.155801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:40.163416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1a90ea53-3e7c-47ab-ad08-7d71399dcf54 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.155036 Mar 08 19:52:40.164006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 336/651] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:40.663248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:40.663872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:40.671187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:40.672030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:40.672439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:40.672876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:40.901777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:40.909328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:40.910818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:40.912199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cc8304a8-bf31-442d-880e-31122d068925 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.253133 Mar 08 19:52:40.912780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 316/652] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:40 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:41.180337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:41.181516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:41.187687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:41.188135 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:41.188932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:41.189367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:41.320879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:41.328129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-10d482dd-e715-4550-8a02-55c3fca2d08a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.151788 Mar 08 19:52:41.328729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 337/653] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:52:41.931375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:41.931975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:41.938179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:41.938629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:41.939395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:41.939829 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:42.068026 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:42.075672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:42.077205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:42.078337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-45dca9b0-a491-4ea3-b7fb-8e029fbf8492 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.151332 Mar 08 19:52:42.078887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 317/654] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:41 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:42.345462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:42.346101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:42.352897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:42.353351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:42.354118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:42.354557 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:42.491890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:42.506728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0b5d9183-1484-44d2-9ea0-5b140ba3ecae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.165167 Mar 08 19:52:42.507301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 338/655] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:43.096264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:43.096997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:43.103455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.103977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.104782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.105224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.241712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:43.250017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:43.251504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:43.252674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6c69dcc8-93b2-44df-be0e-21672e7c23f8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1742 microversion: 2.20 time: 0.160214 Mar 08 19:52:43.253228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 318/656] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:43 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:43.523665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:43.524997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:43.531903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.532390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.533207 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.533645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.672648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:43.679921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-59b643fc-2558-4c4f-b98c-9e293a9da76d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1569 microversion: 2.1 time: 0.160787 Mar 08 19:52:43.680510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 339/657] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:43.696764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7dcafecd-4953-4475-b1fa-288ca9f9dbdc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:43.697317 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7dcafecd-4953-4475-b1fa-288ca9f9dbdc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:43.703088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dcafecd-4953-4475-b1fa-288ca9f9dbdc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.703536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dcafecd-4953-4475-b1fa-288ca9f9dbdc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.704311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dcafecd-4953-4475-b1fa-288ca9f9dbdc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.704760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dcafecd-4953-4475-b1fa-288ca9f9dbdc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.834035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7dcafecd-4953-4475-b1fa-288ca9f9dbdc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "POST /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e/action" status: 202 len: 0 microversion: 2.1 time: 0.141537 Mar 08 19:52:43.834819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 319/658] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 19:52:43 2022] POST /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:52:43.843286 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:43.843897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:43.849838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.850916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.851790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:43.852835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:43.986575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:43.994499 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-39172936-a6c2-430d-8af2-302585f64195 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1517 microversion: 2.1 time: 0.155016 Mar 08 19:52:43.995072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 340/659] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:44.272612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:44.273257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:44.279507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:44.280113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:44.280776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:44.281217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:44.415736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:44.423533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:44.425065 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:44.426278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-24267124-8918-4c86-af35-e6d4c0fcd84b tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1742 microversion: 2.20 time: 0.157525 Mar 08 19:52:44.426788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 320/660] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:44 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:45.010469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:45.011067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:45.017589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:45.018290 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:45.019064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:45.019491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:45.158696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:45.166280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-154e8c0e-8b38-45ff-8498-927f60948e24 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1519 microversion: 2.1 time: 0.159774 Mar 08 19:52:45.166841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 341/661] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:45.445303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:45.446641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:45.453734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:45.454430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:45.455366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:45.455954 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:45.625260 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:45.637993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:45.639851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:45.641146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-20e9c957-c74e-467b-86fb-544ec346e7b3 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.199800 Mar 08 19:52:45.642187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 321/662] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:45 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:46.185440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:46.186817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:46.195763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:46.196403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:46.197445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:46.198308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:46.356097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:46.364652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0019e646-c64d-49f4-ad96-1186b33f059e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.183641 Mar 08 19:52:46.375798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 342/663] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:46.661684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:46.662983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:46.669429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:46.670088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:46.671032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:46.671488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:46.820682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:46.830644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:46.832378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:46.833716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-af5be888-6c4a-4f71-a93a-cb636392bd49 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.176567 Mar 08 19:52:46.834638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 322/664] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:46 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:47.234776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d8dd6ffc-696b-4c0e-b4d7-5afd594162ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:47.235886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d8dd6ffc-696b-4c0e-b4d7-5afd594162ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:47.242065 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8dd6ffc-696b-4c0e-b4d7-5afd594162ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:47.242718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8dd6ffc-696b-4c0e-b4d7-5afd594162ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:47.243695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8dd6ffc-696b-4c0e-b4d7-5afd594162ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:47.244313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8dd6ffc-696b-4c0e-b4d7-5afd594162ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:47.278027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d8dd6ffc-696b-4c0e-b4d7-5afd594162ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/ips" status: 200 len: 147 microversion: 2.1 time: 0.113241 Mar 08 19:52:47.289581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 343/665] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:52:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/ips => generated 147 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:47.383151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:47.384038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:47.393604 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:47.396142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:47.397370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:47.397980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:47.584793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:47.600434 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c580f8df-a1b3-49ec-ac4f-5ebb100efd5c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.220798 Mar 08 19:52:47.601348 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 323/666] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:47.852145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:47.852909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:47.859779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:47.860448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:47.861351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:47.861789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:48.022127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:48.031755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:48.033296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:48.034483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2e9dcd9c-6027-4581-9c6a-67ad226c6dda tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.186242 Mar 08 19:52:48.035355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 344/667] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:47 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:48.512586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-ab988607-029a-466d-a59a-54365dbed77d req-1fc32803-3d73-4841-bd1d-c680897ccbbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29933d05-3536-4ba1-8676-36a83a073710", "name": "network-vif-plugged", "status": "completed", "tag": "4ac3b787-c699-4162-baaf-0b30eccf074d"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:48.529029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ab988607-029a-466d-a59a-54365dbed77d req-1fc32803-3d73-4841-bd1d-c680897ccbbf service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:48.530741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ab988607-029a-466d-a59a-54365dbed77d req-1fc32803-3d73-4841-bd1d-c680897ccbbf service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:48.544836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-ab988607-029a-466d-a59a-54365dbed77d req-1fc32803-3d73-4841-bd1d-c680897ccbbf service nova] Creating event network-vif-plugged:4ac3b787-c699-4162-baaf-0b30eccf074d for instance 29933d05-3536-4ba1-8676-36a83a073710 on hv-cinder-83009 Mar 08 19:52:48.551159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-ab988607-029a-466d-a59a-54365dbed77d req-1fc32803-3d73-4841-bd1d-c680897ccbbf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136822 Mar 08 19:52:48.552450 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 324/668] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:48.618903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:48.619667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:48.627661 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:48.628309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:48.629151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:48.629588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:48.829137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:48.836838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c61b7e6a-ca24-4e2f-984a-72dfdfaeabe4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.221933 Mar 08 19:52:48.837406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 345/669] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:49.055785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:49.056942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:49.064001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:49.064495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:49.065325 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:49.065810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:49.290497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:49.302330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:49.304759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:49.306718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b2401390-29b5-4ea3-a06c-f6cb4fefe8fd tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.254770 Mar 08 19:52:49.307661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 325/670] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:49 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:49.783496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-aa1cbc2c-e2b5-40dd-bb1c-fabd90b3a3b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd956386-4a6e-4ac5-9004-cc8e276a1bf4"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:49.784645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-aa1cbc2c-e2b5-40dd-bb1c-fabd90b3a3b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:49.791651 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa1cbc2c-e2b5-40dd-bb1c-fabd90b3a3b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:49.792109 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa1cbc2c-e2b5-40dd-bb1c-fabd90b3a3b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:49.793536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa1cbc2c-e2b5-40dd-bb1c-fabd90b3a3b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:49.793956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa1cbc2c-e2b5-40dd-bb1c-fabd90b3a3b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:49.856418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:49.857650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:49.864924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:49.865587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:49.866579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:49.867197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:50.087786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-aa1cbc2c-e2b5-40dd-bb1c-fabd90b3a3b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308084 Mar 08 19:52:50.088632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 346/671] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 19:52:49 2022] POST /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:52:50.332009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:50.332741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:50.345309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:50.345864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:50.347246 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:50.347785 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:50.380602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:50.388983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-398266af-eb6d-488c-847f-851f02ba78f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.536885 Mar 08 19:52:50.391088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 326/672] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:50.577176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:50.578147 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-6f81edd8-e98f-40ac-9dc9-c5a0d9a496d5 req-aa79394e-711f-4062-9306-e6eaac8fb729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ec178e-8ba4-4606-8aa8-131038fc027e", "name": "network-vif-unplugged", "status": "completed", "tag": "bf60bdec-d657-4193-8d4c-6d75b8d18de9"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:50.586893 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-6f81edd8-e98f-40ac-9dc9-c5a0d9a496d5 req-aa79394e-711f-4062-9306-e6eaac8fb729 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:50.587411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:50.588869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-6f81edd8-e98f-40ac-9dc9-c5a0d9a496d5 req-aa79394e-711f-4062-9306-e6eaac8fb729 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:50.589105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:50.590330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e559dcf3-bbd5-45e9-bcf2-6e74b85983d5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.262768 Mar 08 19:52:50.602210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 347/673] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:50 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:52:50.611174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-6f81edd8-e98f-40ac-9dc9-c5a0d9a496d5 req-aa79394e-711f-4062-9306-e6eaac8fb729 service nova] Creating event network-vif-unplugged:bf60bdec-d657-4193-8d4c-6d75b8d18de9 for instance 08ec178e-8ba4-4606-8aa8-131038fc027e on hv-cinder-83009 Mar 08 19:52:50.617046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-6f81edd8-e98f-40ac-9dc9-c5a0d9a496d5 req-aa79394e-711f-4062-9306-e6eaac8fb729 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043696 Mar 08 19:52:50.618027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 327/674] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:52:51.408916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:51.409443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:51.417025 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:51.417832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:51.419272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:51.419882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:51.582372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:51.595399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-745c2340-7dce-4182-906f-334be7e6cbcd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.191207 Mar 08 19:52:51.596110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 348/675] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:51 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:51.613558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:51.614367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:51.621504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:51.621954 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:51.622714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:51.623396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:51.773530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:51.782870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:51.784678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:51.786376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-39c46ec9-19ac-4b39-baf3-6f7390ec68df tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.177548 Mar 08 19:52:51.787167 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 328/676] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:51 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:52:52.616840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:52.617653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:52.625397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:52.625856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:52.626662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:52.627146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:52.776956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:52.785714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dd5c6ae3-c160-4d44-8821-5b738107e180 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.172636 Mar 08 19:52:52.795633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 349/677] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:52 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:52.805323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:52.805939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:52.813134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:52.814057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:52.814375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:52.814819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:52.957736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:52.968002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:52.969694 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:52.970856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3a126cfa-6b31-4a60-a2be-b6bdf45f6130 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.169405 Mar 08 19:52:52.971845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 329/678] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:52 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:53.803176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:53.803790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:53.809915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:53.810366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:53.811138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:53.811578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:53.957263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:53.965411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1fb25980-81a2-4d0a-9495-dcd56984a929 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.165410 Mar 08 19:52:53.965977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 350/679] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:53 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:53.989347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:53.989946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:53.996902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:53.997356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:53.998162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:53.998605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:54.139957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:54.148546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:54.150011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:54.151186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d84d36e2-c329-4cb4-8b6f-b02d75d3e898 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.165885 Mar 08 19:52:54.151750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 330/680] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:53 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:54.981832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:54.982441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:54.988602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:54.989058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:54.989906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:54.990303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:55.122884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:55.130155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5b5cbcfe-3c70-44e0-9650-03e8484f651b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.152190 Mar 08 19:52:55.130721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 351/681] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:54 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:55.170305 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:55.170885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:55.177066 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:55.177522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:55.178287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:55.178730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:55.304250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:55.312600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:55.314128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:55.315459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c52f496d-9717-4955-9cce-8c18e67642c8 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1737 microversion: 2.20 time: 0.149015 Mar 08 19:52:55.316110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 331/682] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:55 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:56.147851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:56.148514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:56.154391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:56.154844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:56.155613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:56.156050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:56.299431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:56.306756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bad27a95-a8f2-4714-aa35-ecc863fd8e93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.163165 Mar 08 19:52:56.307304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 352/683] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:56 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:56.334416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:56.335020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:56.341221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:56.341668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:56.342431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:56.342864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:56.475399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:56.483534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:56.485105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:56.486323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-96e4490d-fdb6-4d9e-a9d2-ac6722319ee5 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1719 microversion: 2.20 time: 0.155769 Mar 08 19:52:56.486875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 332/684] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:56 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:57.324827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:57.325434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:57.331661 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:57.332111 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:57.332913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:57.333355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:57.466732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:57.474049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ff2a4ead-3a8f-4c72-9411-98eb8f7f7565 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.153665 Mar 08 19:52:57.474605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 353/685] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:57.504976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:57.505582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:57.512444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:57.512890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:57.513651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:57.514082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:57.653690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:57.661850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:57.663370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:57.664548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bbdc7f63-0238-4fac-bc0a-a5f75aa47748 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1719 microversion: 2.20 time: 0.163486 Mar 08 19:52:57.665284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 333/686] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:57 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:58.490881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:58.491490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:58.498329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:58.498776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:58.499538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:58.499972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:58.631195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:58.638718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4f86d45d-346e-4b2f-9ee7-2725cee28162 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.151790 Mar 08 19:52:58.639406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 354/687] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:52:58.683692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:58.684183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:58.690365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:58.690811 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:58.691566 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:58.691999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:58.823316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:58.831099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:58.832622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:58.833776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-535109d1-49d4-46dc-8a18-3bcf726274af tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1662 microversion: 2.20 time: 0.154577 Mar 08 19:52:58.834327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 334/688] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:58 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:52:58.851662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-053a0fe0-85fa-4b6f-b242-77edb282b7db tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c9a5fbf-e5b6-42a7-990a-6f85d1300046"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:58.852804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-053a0fe0-85fa-4b6f-b242-77edb282b7db tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:58.859206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-053a0fe0-85fa-4b6f-b242-77edb282b7db tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:58.859658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-053a0fe0-85fa-4b6f-b242-77edb282b7db tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:58.860484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-053a0fe0-85fa-4b6f-b242-77edb282b7db tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:58.860922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-053a0fe0-85fa-4b6f-b242-77edb282b7db tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.105978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-053a0fe0-85fa-4b6f-b242-77edb282b7db tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.258294 Mar 08 19:52:59.106569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 355/689] 10.222.0.45 () {62 vars in 1363 bytes} [Tue Mar 8 19:52:58 2022] POST /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-volume_attachments => generated 188 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:52:59.216319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ed87fe25-c04d-4594-bc55-c73fcf8909c7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:59.216825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ed87fe25-c04d-4594-bc55-c73fcf8909c7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:59.222594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed87fe25-c04d-4594-bc55-c73fcf8909c7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.223039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed87fe25-c04d-4594-bc55-c73fcf8909c7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.223840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed87fe25-c04d-4594-bc55-c73fcf8909c7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.224520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed87fe25-c04d-4594-bc55-c73fcf8909c7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.445726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ed87fe25-c04d-4594-bc55-c73fcf8909c7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-volume_attachments/6c9a5fbf-e5b6-42a7-990a-6f85d1300046" status: 202 len: 0 microversion: 2.20 time: 0.233264 Mar 08 19:52:59.446313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 335/690] 10.222.0.45 () {60 vars in 1456 bytes} [Tue Mar 8 19:52:59 2022] DELETE /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-volume_attachments/6c9a5fbf-e5b6-42a7-990a-6f85d1300046 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:52:59.501629 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5a763c04-70d2-4d8d-bf05-3d88365267d1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:59.502173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5a763c04-70d2-4d8d-bf05-3d88365267d1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:59.508449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a763c04-70d2-4d8d-bf05-3d88365267d1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.508901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a763c04-70d2-4d8d-bf05-3d88365267d1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.509669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a763c04-70d2-4d8d-bf05-3d88365267d1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.510107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a763c04-70d2-4d8d-bf05-3d88365267d1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.584099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5a763c04-70d2-4d8d-bf05-3d88365267d1 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "POST /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/action" status: 202 len: 0 microversion: 2.20 time: 0.086372 Mar 08 19:52:59.584929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 356/691] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Mar 8 19:52:59 2022] POST /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:52:59.594343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-a5fbeed2-6177-4004-b792-11c23431a0f5 req-8eaeaad1-edee-480a-a6d9-1aaf40de79e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29933d05-3536-4ba1-8676-36a83a073710", "name": "network-vif-unplugged", "status": "completed", "tag": "4ac3b787-c699-4162-baaf-0b30eccf074d"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:52:59.594771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:59.596263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:59.602822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-a5fbeed2-6177-4004-b792-11c23431a0f5 req-8eaeaad1-edee-480a-a6d9-1aaf40de79e9 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.603300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-a5fbeed2-6177-4004-b792-11c23431a0f5 req-8eaeaad1-edee-480a-a6d9-1aaf40de79e9 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.606869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.607324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.608150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.609057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.617170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.compute.server_external_events [req-a5fbeed2-6177-4004-b792-11c23431a0f5 req-8eaeaad1-edee-480a-a6d9-1aaf40de79e9 service nova] Unable to find a host for instance 29933d05-3536-4ba1-8676-36a83a073710. Dropping event network-vif-unplugged {{(pid=123380) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 19:52:59.618393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-a5fbeed2-6177-4004-b792-11c23431a0f5 req-8eaeaad1-edee-480a-a6d9-1aaf40de79e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029098 Mar 08 19:52:59.619613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 357/692] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 08 19:52:59.656737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:52:59.656737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:52:59.665602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.666055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.666837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:52:59.667271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:52:59.785132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:59.796085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:59.797745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:59.798934 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0490bda8-4a5c-4ee4-a7e9-5a8935f38e97 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1670 microversion: 2.20 time: 0.210064 Mar 08 19:52:59.799473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 336/693] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:52:59 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1670 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:52:59.851809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:52:59.859779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d632df1d-8261-4de6-9c50-f56ccf12033a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.208822 Mar 08 19:52:59.860593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 358/694] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:52:59 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:53:00.817355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:00.818048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:00.824395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:00.825408 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:00.825610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:00.826561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:00.877777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:00.878333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:00.884503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:00.884956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:00.885721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:00.886153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:01.018535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:01.023593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:01.026269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2add5734-618d-4c9e-abaa-c4649d5fedd7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.152364 Mar 08 19:53:01.026931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 359/695] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:01.041111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:01.042608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:01.043738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-91e05166-05c9-452b-965e-167ed343d58a tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.230564 Mar 08 19:53:01.044313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 337/696] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:00 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:02.042987 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:02.043512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:02.049781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:02.050237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:02.051014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:02.051456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:02.063517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:02.064955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:02.074013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:02.075094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:02.076835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:02.077498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:02.218093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:02.226435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c3db3ef0-7af5-4a93-808e-b13a89c4fb1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.187273 Mar 08 19:53:02.228687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 360/697] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:02 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:02.245460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:02.254042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:02.255596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:02.256780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e11c015d-cfd9-4afb-ad6e-1b9bd77a97ba tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.197723 Mar 08 19:53:02.257346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 338/698] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:02 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:03.246004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:03.246613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:03.253716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:03.254174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:03.255066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:03.255511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:03.277019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:03.282376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:03.296052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:03.297193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:03.298256 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:03.299073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:03.430419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:03.438204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-72e1c99d-0cf6-4b1a-8769-d373fa656e15 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.196195 Mar 08 19:53:03.448826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 361/699] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:03.456608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:03.465314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:03.467430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:03.468742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cce1ff78-461d-4e63-9fbf-dc00eefe5474 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.195946 Mar 08 19:53:03.469306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 339/700] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:03 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:04.455477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:04.456090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:04.462503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:04.462982 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:04.463758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:04.464349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:04.488370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:04.489674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:04.502065 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:04.502509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:04.503286 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:04.503902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:04.633509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:04.647825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b284b47b-6d9f-4cff-94ff-7ce071b9d1a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.196708 Mar 08 19:53:04.648469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 362/701] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:04 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:04.680655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:04.688602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:04.690340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:04.691589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-829d66e0-d55b-4163-ac7c-5b6b5d3d7b17 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.207583 Mar 08 19:53:04.693323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 340/702] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:04 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:05.665711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:05.666411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:05.673686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:05.674138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:05.674922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:05.675353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:05.712331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:05.712910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:05.720130 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:05.720843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:05.721788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:05.722384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:05.833494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:05.841891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5e6bd36e-543b-4500-81cf-d2d5999448f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.179691 Mar 08 19:53:05.851838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 363/703] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:05 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:05.870307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:05.878883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:05.880602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:05.881840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4d2bc5fa-4a2d-4685-82d2-bbc2e378c604 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.173379 Mar 08 19:53:05.882489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 341/704] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:05 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:06.860231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:06.861710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:06.869113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:06.870398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:06.871470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:06.872310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:06.905788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:06.907326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:06.916596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:06.924454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:06.925672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:06.926345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:07.107795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:07.126649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:07.134390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-87bf5eb2-79e2-43bf-82b5-bf001800ef62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.279018 Mar 08 19:53:07.135218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 364/705] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:06 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:07.136252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:07.137791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:07.139658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8aa1c9a8-9970-45e6-8762-8836791b43c6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.238481 Mar 08 19:53:07.140314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 342/706] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:06 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:08.151141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:08.151773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:08.159118 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:08.159979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:08.172540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:08.173646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:08.174117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:08.174909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:08.175360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:08.176083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:08.176983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:08.177421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:08.343482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:08.347737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:08.352477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:08.353990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:08.355146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-88aafdfa-b9cb-4cf7-ba03-8e3e62976093 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.199829 Mar 08 19:53:08.356021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 343/707] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:08 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:08.358404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7332f257-db29-4a46-a1ae-34b63bd70300 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.208598 Mar 08 19:53:08.359356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 365/708] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:08 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:09.373401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:09.373994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:09.375340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:09.375955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:09.380394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:09.380845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:09.381625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:09.382059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:09.382614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:09.383066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:09.383848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:09.384304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:09.523107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:09.524569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:09.531570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c6dc1ce2-2dc2-44d0-b985-2c8278004d9b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.160542 Mar 08 19:53:09.532154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 366/709] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:53:09.532934 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:09.534519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:09.535935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d0dda81f-3d65-4ae3-9f56-679554d58308 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.166746 Mar 08 19:53:09.536518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 344/710] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:09 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:10.548848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:10.549373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:10.553605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:10.554254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:10.555843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:10.556311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:10.557481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:10.557606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:10.560555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:10.561009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:10.561782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:10.562223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:10.692991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:10.694645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:10.700329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-abd8fd06-c4f8-434c-b959-ac0b1abddffc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.155402 Mar 08 19:53:10.701401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 367/711] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:10 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:10.702986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:10.704498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:10.705652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b0c0fbad-9b49-465e-8bdd-e747c37aa298 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.155950 Mar 08 19:53:10.706187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 345/712] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:10 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:11.718146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:11.718738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:11.723052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:11.723660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:11.725193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:11.725640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:11.726436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:11.726869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:11.729841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:11.730291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:11.731059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:11.731551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:11.865976 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:11.867969 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:11.873652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fe34e92a-58bd-4489-ab82-60b737e4b177 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.159839 Mar 08 19:53:11.874213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 368/713] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:11.876003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:11.877650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:11.878930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bc5f50f5-675e-4c91-9d63-2d3504096c22 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.159649 Mar 08 19:53:11.879512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 346/714] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:11 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:12.890830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:12.891970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:12.898405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:12.899102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:12.899732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:12.900588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:12.901989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:12.902468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:12.906182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:12.906626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:12.907413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:12.907846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:13.038737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:13.039914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:13.046667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9a4b4cd4-4c13-4337-8c48-c8fc2535ee8f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.160971 Mar 08 19:53:13.047243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 369/715] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:12 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:13.048415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:13.049925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:13.051056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-93e0428e-bbfc-442f-8dbc-7a497b4f740f tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.157816 Mar 08 19:53:13.051607 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 347/716] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:12 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:14.063419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:14.064321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:14.069519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:14.070073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:14.070621 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:14.071078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:14.072111 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:14.072317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:14.076625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:14.077090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:14.077883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:14.078322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:14.210891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:14.212485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:14.218887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:14.219645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-23d2ce1f-66a8-4c4f-8daa-193aba0b7068 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.160123 Mar 08 19:53:14.220214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 370/717] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:14 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:14.220417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:14.221594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ba91a8bb-968a-4b2d-8731-172bfab25a81 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.156424 Mar 08 19:53:14.222140 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 348/718] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:14 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:15.053301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f479739c-6d68-46e5-a0cf-8f7605a29b69 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:15.053819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f479739c-6d68-46e5-a0cf-8f7605a29b69 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:15.059653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f479739c-6d68-46e5-a0cf-8f7605a29b69 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:15.060716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f479739c-6d68-46e5-a0cf-8f7605a29b69 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:15.061474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f479739c-6d68-46e5-a0cf-8f7605a29b69 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:15.061908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f479739c-6d68-46e5-a0cf-8f7605a29b69 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:15.083470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f479739c-6d68-46e5-a0cf-8f7605a29b69 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e/ips" status: 200 len: 149 microversion: 2.1 time: 0.033973 Mar 08 19:53:15.084057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 371/719] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 19:53:15 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e/ips => generated 149 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:53:15.236346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:15.237116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:15.238913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:15.239519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:15.244051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:15.244464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:15.245428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:15.245564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:15.245866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:15.245985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:15.246776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:15.247758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:15.421119 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:15.423128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:15.429089 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:15.430646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:15.430797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b251ec74-897b-46ea-a5ad-46204daa8d33 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.198172 Mar 08 19:53:15.431424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 349/720] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:15 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:15.431799 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-07dab07d-e5d4-4eba-b2a8-0ea0e2e3d304 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.196767 Mar 08 19:53:15.432374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 372/721] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:15 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:15.700984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-b1185cce-e859-42e4-826b-cc086e00894e req-2b30ed86-7f47-4474-87fc-9a6bdaf01e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29933d05-3536-4ba1-8676-36a83a073710", "name": "network-vif-plugged", "status": "completed", "tag": "4ac3b787-c699-4162-baaf-0b30eccf074d"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:53:15.709464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-b1185cce-e859-42e4-826b-cc086e00894e req-2b30ed86-7f47-4474-87fc-9a6bdaf01e49 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:15.709967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-b1185cce-e859-42e4-826b-cc086e00894e req-2b30ed86-7f47-4474-87fc-9a6bdaf01e49 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:15.720870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-b1185cce-e859-42e4-826b-cc086e00894e req-2b30ed86-7f47-4474-87fc-9a6bdaf01e49 service nova] Creating event network-vif-plugged:4ac3b787-c699-4162-baaf-0b30eccf074d for instance 29933d05-3536-4ba1-8676-36a83a073710 on hv-cinder-83009 Mar 08 19:53:15.725740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-b1185cce-e859-42e4-826b-cc086e00894e req-2b30ed86-7f47-4474-87fc-9a6bdaf01e49 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028414 Mar 08 19:53:15.726493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 350/722] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:53:16.449662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:16.450881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:16.452226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:16.452958 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:16.456974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:16.457504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:16.458329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:16.458834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:16.458934 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:16.459319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:16.460090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:16.460553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:16.612211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:16.619977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ef6936de-8cb0-41da-bd11-c23b903a3f86 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.174821 Mar 08 19:53:16.620858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 373/723] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:16 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:16.687628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:16.695401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:16.696955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:16.698097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0019a1c5-fef6-480b-ad25-d5f66ee689d4 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1728 microversion: 2.20 time: 0.251108 Mar 08 19:53:16.698658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 351/724] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:16 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1728 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:17.640626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:17.641157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:17.647561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:17.648017 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:17.648822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:17.649266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:17.717510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:17.718398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:17.724416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:17.724867 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:17.725640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:17.726074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:17.791598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:17.800171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-397b0e04-0e9b-4a03-903c-08b6dcf70c87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.166077 Mar 08 19:53:17.801032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 374/725] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:17 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:17.863742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:17.871529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:17.873099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:17.874229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c1c24742-af75-426a-83b1-c8577c6d46e6 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1715 microversion: 2.20 time: 0.162114 Mar 08 19:53:17.874781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 352/726] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:17 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:53:18.818012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:18.818619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:18.824978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:18.825452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:18.826206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:18.826634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:18.959197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:18.966439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5521c444-2cfa-41c1-b0da-050c6613d233 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.152244 Mar 08 19:53:18.966999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 375/727] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:18 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:19.983157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:19.983739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:19.989968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:19.990411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:19.991163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:19.991598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:20.121641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:20.129526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e84be543-1e8f-4a4a-a3cd-2ea2cf552e1b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.150250 Mar 08 19:53:20.130092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 353/728] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:19 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:21.147309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:21.147963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:21.156137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:21.156615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:21.157392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:21.157830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:21.302295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:21.310231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ae47285d-0f4e-4f88-b7d2-f507c1c8c0ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.166720 Mar 08 19:53:21.310795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 376/729] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:21 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:22.327497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:22.328106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:22.334498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:22.334949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:22.335716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:22.336152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:22.471585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:22.478963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ad46254d-8e08-41e7-8e38-db6fbe0cff65 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.155966 Mar 08 19:53:22.479521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 354/730] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:22 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:23.495773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:23.496409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:23.503236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:23.503685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:23.504488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:23.504929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:23.636043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:23.643959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-249d770b-e1ed-4ca1-b957-f254479bf36b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.152022 Mar 08 19:53:23.644548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 377/731] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:23 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:24.660889 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:24.661501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:24.667898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:24.668370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:24.669128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:24.669554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:24.803115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:24.810964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-72b3bfbe-162e-4129-b791-4821931d9f9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.154181 Mar 08 19:53:24.811553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 355/732] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:25.828385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:25.829020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:25.835309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:25.835760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:25.836560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:25.837000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:25.975493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:25.985108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dfce94b4-baa9-40f1-ab81-d215d43ef793 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.161728 Mar 08 19:53:25.985674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 378/733] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:27.002551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:27.003161 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:27.009484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:27.009939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:27.010702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:27.011142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:27.148312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:27.155595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e1a13def-e6ae-4f6c-8260-bc291142e6a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.156927 Mar 08 19:53:27.156161 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 356/734] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:28.172621 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:28.173236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:28.179644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:28.180098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:28.180924 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:28.181363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:28.313930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:28.321208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ff03a895-39cb-4a48-96e2-d77c36b35af5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.152407 Mar 08 19:53:28.321772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 379/735] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:28 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:29.338720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:29.339315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:29.346178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:29.346626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:29.347384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:29.347817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:29.479695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:29.486965 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d6b08352-845f-4673-ade1-09e47f0a1320 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.152155 Mar 08 19:53:29.487517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 357/736] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:53:30.503444 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:30.503979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:30.510248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:30.510691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:30.511457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:30.511886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:30.646668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:30.653950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-201e7e71-7e09-4e46-aaa3-e52dabef033c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.154455 Mar 08 19:53:30.654517 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 380/737] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:30 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:31.670943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:31.671502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:31.678027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:31.678482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:31.679260 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:31.679701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:31.813369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:31.820605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f168f39c-91a4-469b-93b4-9ccca30e13f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.153554 Mar 08 19:53:31.821161 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 358/738] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:31 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:32.837888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:32.838498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:32.845336 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:32.845788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:32.846555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:32.846992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:32.980249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:32.987573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c30f9ce1-d513-4b78-8d44-494e3737d506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.153519 Mar 08 19:53:32.988140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 381/739] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:32 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:34.004033 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:34.004586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:34.010837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:34.011287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:34.012057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:34.012531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:34.149579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:34.157259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bc919c9c-90ab-42ee-958f-577a001d8fcc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.157213 Mar 08 19:53:34.157819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 359/740] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:33 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:35.173747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:35.174354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:35.180602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:35.181063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:35.181809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:35.182243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:35.316500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:35.324248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-30d1e684-2e69-4bdd-80f7-b01886ab1769 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.154258 Mar 08 19:53:35.325369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 382/741] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:36.342603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:36.343215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:36.349461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:36.349912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:36.350678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:36.351115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:36.482512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:36.489862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e76a94ce-34ac-43c2-9299-b8f277e4b666 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.151582 Mar 08 19:53:36.490426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 360/742] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:37.506880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:37.507396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:37.513758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:37.514202 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:37.514965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:37.515399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:37.648745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:37.655951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a0ca7f33-2838-4d16-8704-37afca6f7ced tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.152944 Mar 08 19:53:37.656562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 383/743] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:38.673023 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:38.673634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:38.679476 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:38.679925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:38.680742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:38.681164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:38.817426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:38.825427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-06d49a31-630a-43d3-95e8-0b3cdc29c174 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.155754 Mar 08 19:53:38.825978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 361/744] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:39.842680 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:39.843295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:39.849684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:39.850136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:39.850927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:39.851345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:39.985201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:39.992538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0f7f624e-214d-4c2a-8ba7-d2279144f499 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.154239 Mar 08 19:53:39.993102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 384/745] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:39 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:41.009746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:41.010293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:41.016682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:41.017134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:41.017905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:41.018342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:41.152265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:41.160506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9af6145a-3553-4896-ae5b-7aead85bb186 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.154347 Mar 08 19:53:41.161071 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 362/746] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:42.177571 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:42.178217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:42.185195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:42.185649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:42.186417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:42.186853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:42.320813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:42.328189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b8c7a82d-32a5-4bcf-9583-f9535e5d5aaf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.154701 Mar 08 19:53:42.328797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 385/747] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:43.344877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:43.345481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:43.351671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:43.352114 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:43.352906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:43.353332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:43.487435 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:43.494674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b7c08a86-d76d-41e3-b6a9-7b50f6a1f3c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.153682 Mar 08 19:53:43.495228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 363/748] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:44.512112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:44.512716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:44.518929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:44.519377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:44.520144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:44.520612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:44.659529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:44.667097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cba98ea7-b7a7-479b-99a7-91a009ae8580 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.158950 Mar 08 19:53:44.667656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 386/749] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:44 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:45.684849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:45.685491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:45.691738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:45.692192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:45.693004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:45.693446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:45.824993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:45.832228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b943ef2a-4921-4e5c-9a71-7b6c7ae65adb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.151806 Mar 08 19:53:45.832818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 364/750] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:53:46.848603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:46.849211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:46.855303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:46.855743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:46.856525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:46.856957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:46.993942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:47.001898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e767725f-e81d-4518-8687-30d4bb9c8a4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.157087 Mar 08 19:53:47.002461 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 387/751] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:48.018970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:48.019517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:48.025819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:48.026271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:48.027041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:48.028050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:48.162543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1ab0abc8-58fe-4a3f-abb7-f3373965db77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:48.163592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1ab0abc8-58fe-4a3f-abb7-f3373965db77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:48.166306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:48.170889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ab0abc8-58fe-4a3f-abb7-f3373965db77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:48.171338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ab0abc8-58fe-4a3f-abb7-f3373965db77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:48.172116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ab0abc8-58fe-4a3f-abb7-f3373965db77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:48.172575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ab0abc8-58fe-4a3f-abb7-f3373965db77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:48.174980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0c720de5-9e90-4bb8-8a95-7b891fef9204 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1575 microversion: 2.1 time: 0.159936 Mar 08 19:53:48.175555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 365/752] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:48.201042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1ab0abc8-58fe-4a3f-abb7-f3373965db77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042717 Mar 08 19:53:48.201584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 388/753] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 19:53:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:53:48.211055 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dc0731e9-b44c-488a-83e6-d70df67e12d2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:48.211544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dc0731e9-b44c-488a-83e6-d70df67e12d2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:48.217928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc0731e9-b44c-488a-83e6-d70df67e12d2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:48.218380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc0731e9-b44c-488a-83e6-d70df67e12d2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:48.219147 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc0731e9-b44c-488a-83e6-d70df67e12d2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:48.219585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc0731e9-b44c-488a-83e6-d70df67e12d2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:48.250166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dc0731e9-b44c-488a-83e6-d70df67e12d2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4" status: 200 len: 194 microversion: 2.1 time: 0.042952 Mar 08 19:53:48.250758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 366/754] 10.222.0.45 () {58 vars in 1412 bytes} [Tue Mar 8 19:53:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:53:49.191715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:49.192337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:49.198509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:49.198953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:49.200273 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:49.200722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:49.331328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:49.338542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a78ed669-3808-45bc-9194-31e994a59364 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1562 microversion: 2.1 time: 0.150640 Mar 08 19:53:49.339101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 389/755] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:53:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:51.915115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-4e118d1f-a7f1-48d6-9be5-0c0bade27b6d req-da58e0e5-7047-4d7d-afd7-8cc69b0f9b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ec178e-8ba4-4606-8aa8-131038fc027e", "name": "network-vif-plugged", "status": "completed", "tag": "bf60bdec-d657-4193-8d4c-6d75b8d18de9"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:53:51.924489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-4e118d1f-a7f1-48d6-9be5-0c0bade27b6d req-da58e0e5-7047-4d7d-afd7-8cc69b0f9b28 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:51.924936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-4e118d1f-a7f1-48d6-9be5-0c0bade27b6d req-da58e0e5-7047-4d7d-afd7-8cc69b0f9b28 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:51.939553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-4e118d1f-a7f1-48d6-9be5-0c0bade27b6d req-da58e0e5-7047-4d7d-afd7-8cc69b0f9b28 service nova] Creating event network-vif-plugged:bf60bdec-d657-4193-8d4c-6d75b8d18de9 for instance 08ec178e-8ba4-4606-8aa8-131038fc027e on hv-cinder-83009 Mar 08 19:53:51.944654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-4e118d1f-a7f1-48d6-9be5-0c0bade27b6d req-da58e0e5-7047-4d7d-afd7-8cc69b0f9b28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Mar 08 19:53:51.945487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 367/756] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:53:56.191541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cf30ed76-ad44-4911-8210-ee37d0da00cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:56.192502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cf30ed76-ad44-4911-8210-ee37d0da00cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:56.198628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf30ed76-ad44-4911-8210-ee37d0da00cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:56.199082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf30ed76-ad44-4911-8210-ee37d0da00cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:56.200037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf30ed76-ad44-4911-8210-ee37d0da00cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:56.200546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cf30ed76-ad44-4911-8210-ee37d0da00cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:56.227964 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cf30ed76-ad44-4911-8210-ee37d0da00cf tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040351 Mar 08 19:53:56.228547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 390/757] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Mar 8 19:53:56 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:53:56.285995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:56.286575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:56.293354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:56.293871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:56.294660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:56.295098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:56.319084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:53:56.390465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e34eb956-1f37-4847-b573-69bdb57f7875 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 204 len: 0 microversion: 2.20 time: 0.108919 Mar 08 19:53:56.391123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 368/758] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Mar 8 19:53:56 2022] DELETE /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:53:56.399777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:56.400692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:56.406481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:56.406936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:56.407703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:56.408139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:56.535195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:56.543390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:56.544938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:56.546081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f8be1db4-2779-461d-936e-880a1b990580 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.150183 Mar 08 19:53:56.546631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 391/759] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:56 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:57.564762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:57.565372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:57.571548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:57.571996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:57.572789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:57.573224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:57.703509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:57.711241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:57.712782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:57.713923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ed600b8f-7861-41eb-bdb7-1197ecde9c3d tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1721 microversion: 2.20 time: 0.153554 Mar 08 19:53:57.714484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 369/760] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:57 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:58.732921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:58.734243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:58.750774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:58.753734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:58.754534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:58.755526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:58.825572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-47abaaf1-a4e4-4968-af63-459153226188 req-9d259b5b-02b4-4b8c-8485-eb65d69cfe66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29933d05-3536-4ba1-8676-36a83a073710", "name": "network-vif-deleted", "tag": "4ac3b787-c699-4162-baaf-0b30eccf074d"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:53:58.841816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-47abaaf1-a4e4-4968-af63-459153226188 req-9d259b5b-02b4-4b8c-8485-eb65d69cfe66 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:58.842383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-47abaaf1-a4e4-4968-af63-459153226188 req-9d259b5b-02b4-4b8c-8485-eb65d69cfe66 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:58.855939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-47abaaf1-a4e4-4968-af63-459153226188 req-9d259b5b-02b4-4b8c-8485-eb65d69cfe66 service nova] Creating event network-vif-deleted:4ac3b787-c699-4162-baaf-0b30eccf074d for instance 29933d05-3536-4ba1-8676-36a83a073710 on hv-cinder-83009 Mar 08 19:53:58.857386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:58.863118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-47abaaf1-a4e4-4968-af63-459153226188 req-9d259b5b-02b4-4b8c-8485-eb65d69cfe66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142056 Mar 08 19:53:58.864632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 392/761] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:53:58.873593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:58.878764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df63dc8dd51a4afbb03e84060ace90ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8fc81146d843659f7b027db2238ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:53:58.881499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bc991f58-ae1f-4ac8-856c-b4e642f5542e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 200 len: 1365 microversion: 2.20 time: 0.152408 Mar 08 19:53:58.882605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 370/762] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:58 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:53:59.903367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:59.904057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:53:59.910484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:59.910940 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:59.911709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:53:59.912146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:53:59.924951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] HTTP exception thrown: Instance 29933d05-3536-4ba1-8676-36a83a073710 could not be found. Mar 08 19:53:59.925546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Returning 404 to user: Instance 29933d05-3536-4ba1-8676-36a83a073710 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:53:59.926354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3283249e-986b-4a38-b080-692458f7e120 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 404 len: 111 microversion: 2.20 time: 0.029898 Mar 08 19:53:59.926892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 393/763] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 19:53:59 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:53:59.935342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e5e69c14-d747-403d-98e2-7b0e3da45bca tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '.version_select at 0x7f0704dcd5e0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:53:59.952244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e5e69c14-d747-403d-98e2-7b0e3da45bca tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682982161" status: 204 len: 0 microversion: 2.20 time: 0.020736 Mar 08 19:53:59.952826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 371/764] 10.222.0.45 () {60 vars in 1258 bytes} [Tue Mar 8 19:53:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682982161 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 08 19:55:09.686101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:09.686602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:09.692826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:09.693281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:09.693399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-08a87d71-79bd-4a29-a099-7e216c38c9cd req-8cb28b36-4941-4c5c-a75c-79e6213dddc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ec178e-8ba4-4606-8aa8-131038fc027e", "tag": "bf60bdec-d657-4193-8d4c-6d75b8d18de9"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:55:09.694065 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:09.694499 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:09.701852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-08a87d71-79bd-4a29-a099-7e216c38c9cd req-8cb28b36-4941-4c5c-a75c-79e6213dddc0 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:09.702299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-08a87d71-79bd-4a29-a099-7e216c38c9cd req-8cb28b36-4941-4c5c-a75c-79e6213dddc0 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:09.713148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-08a87d71-79bd-4a29-a099-7e216c38c9cd req-8cb28b36-4941-4c5c-a75c-79e6213dddc0 service nova] Creating event network-changed:bf60bdec-d657-4193-8d4c-6d75b8d18de9 for instance 08ec178e-8ba4-4606-8aa8-131038fc027e on hv-cinder-83009 Mar 08 19:55:09.718645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-08a87d71-79bd-4a29-a099-7e216c38c9cd req-8cb28b36-4941-4c5c-a75c-79e6213dddc0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030373 Mar 08 19:55:09.719551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 372/765] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:55:09.722195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:55:09.804636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ab2449f2-d526-4960-bf69-8deeada7c39c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "DELETE /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 204 len: 0 microversion: 2.1 time: 0.122871 Mar 08 19:55:09.808850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 394/766] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 19:55:09 2022] DELETE /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:55:09.814701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:09.815603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:09.822562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:09.823155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:09.824032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:09.824604 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:10.053821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:10.061907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ba395b30-a3d0-4c6c-8f51-702a307e2371 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1568 microversion: 2.1 time: 0.251508 Mar 08 19:55:10.062482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 373/767] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:11.078837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:11.079516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:11.085793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:11.086238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:11.086990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:11.087417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:11.224834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:11.232162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-be7762dc-79a4-4dc9-95af-cc855a0f21df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1449 microversion: 2.1 time: 0.157494 Mar 08 19:55:11.232731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 395/768] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:11.829639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-3ff01cf4-0271-46ef-b3c5-bfa24b89b8d3 req-6b447456-082c-4d43-a14d-a42035def6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ec178e-8ba4-4606-8aa8-131038fc027e", "name": "network-vif-deleted", "tag": "bf60bdec-d657-4193-8d4c-6d75b8d18de9"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:55:11.838545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-3ff01cf4-0271-46ef-b3c5-bfa24b89b8d3 req-6b447456-082c-4d43-a14d-a42035def6f8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:11.838999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-3ff01cf4-0271-46ef-b3c5-bfa24b89b8d3 req-6b447456-082c-4d43-a14d-a42035def6f8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:11.850638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-3ff01cf4-0271-46ef-b3c5-bfa24b89b8d3 req-6b447456-082c-4d43-a14d-a42035def6f8 service nova] Creating event network-vif-deleted:bf60bdec-d657-4193-8d4c-6d75b8d18de9 for instance 08ec178e-8ba4-4606-8aa8-131038fc027e on hv-cinder-83009 Mar 08 19:55:11.855668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-3ff01cf4-0271-46ef-b3c5-bfa24b89b8d3 req-6b447456-082c-4d43-a14d-a42035def6f8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029718 Mar 08 19:55:11.856245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 374/769] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 19:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:55:12.249528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:12.250135 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:12.256945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:12.257624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:12.258393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:12.258993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:12.322524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:12.329754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f969cbe7-ed5d-43f3-88c1-aa63a67500a6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.084082 Mar 08 19:55:12.330311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 396/770] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:12 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:13.355201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:13.355839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:13.361833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:13.362281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:13.363048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:13.363484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:13.426716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:13.434522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b8839a16-2497-4be7-96b5-a1d9666d1297 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083989 Mar 08 19:55:13.435081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 375/771] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:14.450990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:14.451596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:14.457854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:14.458873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:14.459667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:14.460094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:14.520022 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:14.528818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f61e07ff-2d05-446b-bea0-413a2f0b30d6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081598 Mar 08 19:55:14.529381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 397/772] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:14 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:15.545494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:15.546099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:15.552833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:15.553282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:15.554035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:15.554466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:15.615467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:15.622897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2fdad8f8-97b9-4eac-bd72-1a9de5b7881e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081202 Mar 08 19:55:15.623454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 376/773] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:15 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:16.639863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:16.640520 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:16.647401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:16.647855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:16.648660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:16.649098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:16.706392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:16.714117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9c8123b3-695e-425b-bf3b-f70399ab5025 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078127 Mar 08 19:55:16.714676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 398/774] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:16 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:17.730836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:17.731370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:17.737619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:17.738072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:17.738860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:17.739277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:17.798806 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:17.806307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-91ad968a-fc03-4a4d-bbbe-f067adbd17a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079393 Mar 08 19:55:17.806868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 377/775] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:17 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:18.822848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:18.823465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:18.829778 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:18.830232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:18.831003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:18.831438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:18.889955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:18.897248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a6eef03b-a944-4de5-9eff-122785c72bfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078232 Mar 08 19:55:18.897795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 399/776] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:18 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:19.913918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:19.914630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:19.920963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:19.921289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:19.922060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:19.922497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:19.980737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:19.987885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b822f843-85ef-4f37-afbc-0468c8b01088 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077780 Mar 08 19:55:19.988464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 378/777] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:19 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:21.005446 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:21.006054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:21.011754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:21.012196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:21.012994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:21.013430 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:21.073586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:21.080717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-005a8da4-e998-47ef-9fad-1dca347b5ecd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079781 Mar 08 19:55:21.081270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 400/778] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:20 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:22.097381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:22.098191 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:22.105417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:22.105866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:22.106630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:22.107066 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:22.165466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:22.172643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-07510cf2-07a0-4ac3-9d25-ce388cede04c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079075 Mar 08 19:55:22.173230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 379/779] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:22 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:23.188197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:23.188838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:23.195652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:23.196102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:23.196894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:23.197332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:23.254339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:23.262178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ffbeaaeb-bd96-47a0-81a3-a490c4a0881d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077859 Mar 08 19:55:23.262735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 401/780] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:23 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:24.279396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:24.279996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:24.286512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:24.286957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:24.287719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:24.288152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:24.346515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:24.353606 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c788686b-7e07-409a-b219-98d1343757d8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078028 Mar 08 19:55:24.354165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 380/781] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:25.370382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:25.370935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:25.377495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:25.377954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:25.378735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:25.379173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:25.440448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:25.447846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0a883f00-dcb9-4e93-ac3a-fc412856edab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081412 Mar 08 19:55:25.448424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 402/782] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:26.464227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:26.464863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:26.471123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:26.471565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:26.472342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:26.472772 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:26.537247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:26.544560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3f71cdae-6949-4313-b4b2-a047ecef40e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.084144 Mar 08 19:55:26.545123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 381/783] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:27.561724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:27.562292 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:27.569120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:27.569569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:27.570339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:27.570803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:27.629244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:27.637176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ac3c828d-2a8f-4eb6-97ed-15f1854fb4a0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079356 Mar 08 19:55:27.637750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 403/784] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:27 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:28.654698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:28.655309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:28.661910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:28.662365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:28.663133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:28.663569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:28.725739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:28.733134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c3e87413-663f-475c-a4a6-10b0b75bbfc1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082877 Mar 08 19:55:28.733698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 382/785] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:28 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:29.749516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:29.750122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:29.756694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:29.757150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:29.757945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:29.758388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:29.816391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:29.823598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3946f1fb-73fa-4eab-b888-c44a554f6551 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077911 Mar 08 19:55:29.824154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 404/786] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:30.840009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:30.840679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:30.846884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:30.847328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:30.848085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:30.848547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:30.907569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:30.916866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-430746ec-14dd-43ec-b7b7-f513d5a2ad6b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079543 Mar 08 19:55:30.916866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 383/787] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:30 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:31.932496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:31.933167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:31.940523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:31.940979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:31.941763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:31.942209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:32.001105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:32.008964 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b466e37e-2be9-4553-90bd-7b65e91a3804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080264 Mar 08 19:55:32.009526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 405/788] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:31 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:33.025932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:33.026539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:33.029743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:55:33.031399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 19:55:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e (ip 10.222.0.45) !!! Mar 08 19:55:33.034029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:33.035059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:33.035851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:33.037195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:33.095397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:33.102654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-311ad37f-66fb-48e3-8d9d-685d3672c351 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081205 Mar 08 19:55:33.103213 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 384/789] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:33 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:34.118979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:34.119592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:34.125925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:34.126379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:34.127151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:34.127590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:34.186118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:34.193401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a8ff5916-4ca4-45f3-8ea5-18e82e4b2bbb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078282 Mar 08 19:55:34.193961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 406/790] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:35.210504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:35.211113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:35.218012 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:35.218462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:35.219220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:35.219654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:35.277327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:35.285062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e60c7da5-f698-454a-b293-8e0d01ab2cef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078507 Mar 08 19:55:35.285629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 385/791] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:36.300969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:36.301659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:36.307995 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:36.308490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:36.309263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:36.309704 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:36.369939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:36.377488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-192529ff-4cc6-46d2-921c-e4141c0a0deb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080376 Mar 08 19:55:36.378077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 407/792] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:37.394019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:37.394632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:37.400644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:37.401191 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:37.401972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:37.402414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:37.463434 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:37.470682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bf1ea8e5-9dcc-4325-aafb-9f8ad103f6fc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080573 Mar 08 19:55:37.471249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 386/793] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:38.486877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:38.487475 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:38.494315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:38.494756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:38.495505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:38.495929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:38.557771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:38.565321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d27091a7-b650-4ddd-859e-e00161ce82c3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082291 Mar 08 19:55:38.565878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 408/794] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:39.582396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:39.582997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:39.589781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:39.590222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:39.590982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:39.591417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:39.653782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:39.661293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-089b6e62-871a-451d-91ec-ee654cf8ab73 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082752 Mar 08 19:55:39.661872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 387/795] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:39 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:40.677849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:40.678383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:40.685660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:40.686114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:40.686889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:40.687325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:40.751357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:40.759154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-35bec38e-a52c-40e0-8826-7e613dd003cc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085239 Mar 08 19:55:40.759715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 409/796] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:41.775692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:41.776222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:41.782502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:41.783220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:41.783989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:41.784531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:41.843823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:41.851022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-88c538e9-0a17-4425-9c29-d66cf447818e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079230 Mar 08 19:55:41.851589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 388/797] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:42.867511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:42.868118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:42.874543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:42.874995 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:42.875759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:42.876198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:42.935215 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:42.942555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1f52cbb5-d199-4acc-98be-1dd83cf6b624 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079476 Mar 08 19:55:42.943197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 410/798] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:43.959128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:43.959741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:43.966676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:43.967128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:43.967896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:43.968357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:44.026972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:44.034578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7ce193f0-9c3c-4f71-9ada-0088356361a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079305 Mar 08 19:55:44.035140 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 389/799] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:45.051944 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:45.052605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:45.059450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:45.059902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:45.060715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:45.061176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:45.118902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:45.126247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-245a0a4b-1efb-48b0-8edd-6ec8576cf6ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078046 Mar 08 19:55:45.127077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 411/800] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:46.142801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:46.143438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:46.149709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:46.150163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:46.150930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:46.151368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:46.209195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:46.216482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fca5e79d-2433-4c09-b529-546ec14f5c2d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077448 Mar 08 19:55:46.217050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 390/801] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:47.232851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:47.233465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:47.239760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:47.240218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:47.241018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:47.242116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:47.300040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:47.307932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5cacaab1-945c-4742-936a-baae7b4aebde tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078942 Mar 08 19:55:47.308525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 412/802] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:48.324887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:48.325482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:48.331673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:48.332124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:48.332928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:48.333362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:48.390808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:48.398145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b4e819cc-a7e3-4188-abdc-06490775e01b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077160 Mar 08 19:55:48.398705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 391/803] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:49.414527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:49.415087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:49.421316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:49.421770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:49.422537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:49.422973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:49.482907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:49.490066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-680cedf8-588b-4ae3-adc1-e0a2c7f04762 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079941 Mar 08 19:55:49.490666 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 413/804] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:50.506642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:50.507835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:50.514225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:50.514675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:50.515442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:50.515880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:50.574080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:50.581224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-54227c9b-0c34-49ee-9f6c-ac28d6377e20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078498 Mar 08 19:55:50.581781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 392/805] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:50 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:51.597105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:51.597717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:51.604436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:51.604909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:51.605671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:51.606098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:51.815684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:51.823967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-29b5135f-12b8-416c-b0f0-b9caeaaf0b02 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.230613 Mar 08 19:55:51.824572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 414/806] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:51 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:52.841186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:52.841785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:52.848016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:52.848493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:52.849259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:52.849691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:52.916335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:52.923736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d7856075-c8a9-4688-992f-679223c3ef4e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.086397 Mar 08 19:55:52.924282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 393/807] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:52 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:53.940416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:53.941024 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:53.948122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:53.948586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:53.949353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:53.949782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:54.235380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:54.242888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-452456af-ace4-4993-8275-96476b287115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.306486 Mar 08 19:55:54.243436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 415/808] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:53 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:55.259873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:55.260458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:55.266655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:55.267106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:55.267869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:55.268312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:55.326938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:55.334259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-46fea569-a1a4-4187-b4fa-d413a79713a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078980 Mar 08 19:55:55.334845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 394/809] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:55 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:56.350874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:56.351480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:56.358150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:56.358602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:56.359373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:56.359810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:56.418547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:56.425731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bc528c93-a58c-4017-830c-a13bdd393c98 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078691 Mar 08 19:55:56.426291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 416/810] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:56 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:57.442695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:57.443290 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:57.450104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:57.450549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:57.451300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:57.451730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:57.510465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:57.517558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a7ce8d4f-a238-4c0d-9c3d-fa787b9e1235 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078715 Mar 08 19:55:57.518105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 395/811] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:58.534582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:58.535192 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:58.541582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:58.541979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:58.542748 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:58.543182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:58.600632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:58.607826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e80b6f29-bfbb-4feb-bb4b-2e7ab3a6c063 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077426 Mar 08 19:55:58.608394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 417/812] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:55:58.935536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:55:58.935732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 19:55:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:55:59.623452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:55:59.624182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:55:59.630406 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:59.630857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:59.631647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:55:59.632083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:55:59.691263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:55:59.698562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eaad08cb-e70c-45ea-acf9-e96bd45274ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078978 Mar 08 19:55:59.699123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 396/813] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:55:59 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:00.715023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:00.715556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:00.721894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:00.722345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:00.723153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:00.723596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:00.781941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:00.790047 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f506824d-ef6f-497d-8a85-4aa45df89bc2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078927 Mar 08 19:56:00.790587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 418/814] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:01.807092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:01.808381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:01.820500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:01.820500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:01.820500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:01.820500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:01.876446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:01.884097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6f8ff4bd-419c-48d9-ae08-9c5806fc4a52 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081420 Mar 08 19:56:01.884685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 397/815] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:01 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:02.901226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:02.901886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:02.908685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:02.909143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:02.909950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:02.910389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:02.970526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:02.977702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d5bcf771-f807-47ba-a177-d3d0c9a8960c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080982 Mar 08 19:56:02.978250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 419/816] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:02 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:03.994807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:03.995410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:04.001651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:04.002100 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:04.002870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:04.003281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:04.060601 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:04.067977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-24d51d4e-7aef-4c00-b98c-b0e5901b7f37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077343 Mar 08 19:56:04.068589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 398/817] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:05.084372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:05.085472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:05.091559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:05.092000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:05.092786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:05.093215 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:05.152892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:05.160593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-46a2e1b4-1732-4c8f-90b5-0af509a3e3b7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079910 Mar 08 19:56:05.161148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 420/818] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:05 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:06.177239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:06.177855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:06.184128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:06.184615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:06.185384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:06.185829 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:06.246582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:06.253830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9b225a72-81fc-43b8-aa64-d48b69b1e92e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080434 Mar 08 19:56:06.254394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 399/819] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:06 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:07.270584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:07.271120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:07.277421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:07.277870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:07.278639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:07.279074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:07.337035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:07.344256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-91864e55-204a-487c-9345-b191047cd472 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077698 Mar 08 19:56:07.344831 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 421/820] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:07 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:08.361042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:08.361653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:08.368195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:08.368667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:08.369428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:08.369861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:08.427108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:08.434992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4a6d8e11-5698-4740-895c-157838903d10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077820 Mar 08 19:56:08.435554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 400/821] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:08 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:09.451082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:09.451611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:09.457879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:09.458333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:09.459096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:09.459533 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:09.517372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:09.524588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9fbcd534-35b2-4461-8d94-d762a3b7b4cb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077441 Mar 08 19:56:09.525142 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 422/822] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:10.541396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:10.542005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:10.548449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:10.548906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:10.549679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:10.550116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:10.612925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:10.620097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e19a6344-14bb-4b26-9c5a-d486a2abc84b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082568 Mar 08 19:56:10.620684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 401/823] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:10 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:11.637222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:11.637828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:11.644038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:11.644527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:11.645291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:11.645724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:11.703391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:11.710846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-27ac7a5e-c8d1-4ab6-af2b-397b3b5cdba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077477 Mar 08 19:56:11.712697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 423/824] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:12.727439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:12.728003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:12.734441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:12.734901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:12.735670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:12.736106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:12.796740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:12.805059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-322836bb-54c3-49f3-9c4e-b5ea0b576308 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081600 Mar 08 19:56:12.805613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 402/825] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:12 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:13.822316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:13.822927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:13.828990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:13.829523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:13.830196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:13.830672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:13.892405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:13.899649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ca30a520-72f6-4e03-ae5b-7379765fb2d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081936 Mar 08 19:56:13.900194 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 424/826] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:14.916431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:14.917041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:14.923307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:14.923760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:14.924552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:14.924988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:14.982805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:14.989848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8b141383-d2e5-4c16-bdf2-9fbf491e26a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077327 Mar 08 19:56:14.990407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 403/827] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:14 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:16.006206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:16.006821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:16.013068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:16.013524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:16.014298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:16.014734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:16.072664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:16.079834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0cafa986-f978-4961-9dc9-297a5c501a10 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077423 Mar 08 19:56:16.080404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 425/828] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:16 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:17.096863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:17.097469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:17.103800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:17.104245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:17.105039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:17.105473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:17.166914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:17.174199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-111760ba-3a76-4290-9f10-94c38ac74969 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081160 Mar 08 19:56:17.174765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 404/829] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:17 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:18.191802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:18.192556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:18.199486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:18.200022 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:18.200841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:18.201280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:18.261669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:18.268897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3147be8c-b2d5-4f4b-954a-0c76161badb7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081909 Mar 08 19:56:18.269460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 426/830] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:18 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:19.286276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:19.286823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:19.292998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:19.293443 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:19.294208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:19.294643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:19.352681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:19.360076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f37af292-9820-40e1-b863-5097bdfa50de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077963 Mar 08 19:56:19.360668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 405/831] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:19 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:20.377135 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:20.377659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:20.383559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:20.384002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:20.384792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:20.385230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:20.442459 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:20.450085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-02d1b5fc-7054-4976-98b4-2c34f52d6250 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.076909 Mar 08 19:56:20.450628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 427/832] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:20 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:21.466652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:21.467212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:21.473504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:21.473951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:21.474712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:21.475730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:21.534748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:21.542681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-96014d00-39ce-421f-b755-12cc2e723246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079981 Mar 08 19:56:21.543243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 406/833] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:21 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:22.559037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:22.559648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:22.565912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:22.566361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:22.567122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:22.567554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:22.625435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:22.633117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d1ad47de-0fe0-4f77-adb4-ddf2d91de354 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077977 Mar 08 19:56:22.633669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 428/834] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:22 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:23.650272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:23.650832 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:23.657432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:23.657882 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:23.658651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:23.659090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:23.717212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:23.724405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7d0fc5c1-9cfc-4fcf-89d6-59279dca62da tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078610 Mar 08 19:56:23.724965 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 407/835] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:23 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:24.741648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:24.742188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:24.748481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:24.748931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:24.749698 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:24.750138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:24.808462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:24.815702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b9dd0767-0906-4a5e-aa09-42e55882a237 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077962 Mar 08 19:56:24.816258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 429/836] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:25.832624 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:25.833233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:25.839625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:25.840076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:25.840873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:25.841310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:25.908241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:25.917497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b8549322-4aac-4479-b899-a6fdad11518a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.088695 Mar 08 19:56:25.918068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 408/837] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:26.933830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:26.934466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:26.940740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:26.941191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:26.941958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:26.942393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:27.006862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:27.014604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-323c0000-ea4c-4e66-8f10-77731bdcec87 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.084575 Mar 08 19:56:27.015156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 430/838] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:28.031468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:28.032503 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:28.039332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:28.039762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:28.040546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:28.040980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:28.097431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:28.105236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5311b2a3-952e-46cc-b969-d97c0ea593a8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077557 Mar 08 19:56:28.105985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 409/839] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:28 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:29.120858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:29.121469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:29.127708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:29.128155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:29.128954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:29.129390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:29.188276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:29.196572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e0d8e88b-d14c-44aa-8c93-7682671d91f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079401 Mar 08 19:56:29.197156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 431/840] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:30.213664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:30.214277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:30.220696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:30.221139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:30.221945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:30.222385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:30.283970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:30.291906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-132eefaf-6657-4bdb-afd5-2d52e18935dc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082590 Mar 08 19:56:30.292490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 410/841] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:30 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:31.309054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:31.309635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:31.315790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:31.316310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:31.317078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:31.317510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:31.376831 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:31.384117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e1edaf2e-0660-4105-9e8b-e60209d3a712 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079006 Mar 08 19:56:31.384766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 432/842] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:31 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:32.400072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:32.400710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:32.407425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:32.407876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:32.408689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:32.409149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:32.469384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:32.481223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-db7c8df9-29ef-42b2-b2cd-3f854cb518d4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085002 Mar 08 19:56:32.490188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 411/843] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:32 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:33.497824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:33.498395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:33.504587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:33.505038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:33.505802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:33.506240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:33.568677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:33.576039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0d03b27f-9f63-4ddb-9247-cc02c56e25c0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082169 Mar 08 19:56:33.576635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 433/844] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:33 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:34.592547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:34.593156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:34.599421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:34.599871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:34.600663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:34.601597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:34.662143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:34.669514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a418d944-0c95-4408-acea-35681a3319b3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080905 Mar 08 19:56:34.670064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 412/845] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:56:35.685635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:35.686245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:35.692553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:35.693009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:35.693790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:35.694228 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:35.753171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:35.761021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e6f34385-81ad-4113-9ba1-24af8938f613 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079215 Mar 08 19:56:35.761580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 434/846] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:36.778710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:36.779307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:36.785777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:36.786229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:36.787072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:36.787551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:36.853264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:36.860945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8160970f-7ca3-4310-bdfa-765e6c963014 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.086268 Mar 08 19:56:36.861544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 413/847] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:37.877310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:37.877842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:37.884169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:37.884653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:37.885423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:37.885892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:37.944999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:37.952218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-09cf6c75-2da6-4dfd-bf2c-ea056bc87651 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078822 Mar 08 19:56:37.952795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 435/848] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:38.969792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:38.970249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:38.979558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:38.980011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:38.980827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:38.981257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:39.042046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:39.049263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2e396b7d-dc3f-467a-93a3-3c513b673f6f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083437 Mar 08 19:56:39.049813 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 414/849] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:40.066116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:40.066728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:40.073551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:40.074001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:40.074773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:40.075208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:40.136396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:40.143768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f0c664c5-d03b-453c-8654-8ee90a096568 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081394 Mar 08 19:56:40.144343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 436/850] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:41.161233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:41.161841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:41.168014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:41.168494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:41.169265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:41.169699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:41.229619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:41.237052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5d472788-91e3-4b2f-9d7c-e99a68895a95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079963 Mar 08 19:56:41.237613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 415/851] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:42.253853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:42.254504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:42.260845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:42.261305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:42.262082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:42.262550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:42.320732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:42.327868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e0282482-440a-4cdc-a3f9-fff33a306d57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077796 Mar 08 19:56:42.328511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 437/852] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:43.344810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:43.345428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:43.351693 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:43.352143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:43.353449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:43.353888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:43.414998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:43.422565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-178029f5-dfe1-45b0-9b9f-0be7b6116fbc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081626 Mar 08 19:56:43.423127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 416/853] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:44.438870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:44.439485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:44.445790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:44.446843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:44.447620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:44.448059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:44.505936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:44.513905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-62ad7741-4826-497c-9df3-4b0ebc2c69a2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078936 Mar 08 19:56:44.514460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 438/854] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:44 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:45.530783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:45.531398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:45.537963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:45.538413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:45.539184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:45.539619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:45.598158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:45.607350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ea8fcbde-8b72-451c-a35f-4a7209ae725b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078461 Mar 08 19:56:45.607939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 417/855] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:46.625772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:46.626388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:46.632708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:46.633162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:46.633955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:46.634391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:46.694519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:46.701759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1aeb9d0d-f697-4eea-86ff-91962f80f6e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079861 Mar 08 19:56:46.702316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 439/856] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:47.718180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:47.718712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:47.724921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:47.725373 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:47.726137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:47.726573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:47.784387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:47.791571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-073fa4b5-3999-40e4-9e78-f16e2964d14f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077274 Mar 08 19:56:47.792128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 418/857] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:48.808786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:48.809330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:48.815710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:48.816170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:48.817007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:48.817451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:48.875376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:48.882579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6f7dc863-a24a-4fb1-9cc4-2f6d958c4ed6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078379 Mar 08 19:56:48.883134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 440/858] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:49.899150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:49.899755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:49.906300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:49.906749 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:49.907789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:49.908227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:49.966822 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:49.974150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6f542cef-2957-4f2d-ad41-f3018df785bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078873 Mar 08 19:56:49.974706 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 419/859] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:50.990604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:50.991210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:50.997083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:50.997530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:50.998291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:50.998724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:51.056180 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:51.063325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-190c1e0d-dabe-409a-aee9-f3cfa4d0fca6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.076699 Mar 08 19:56:51.063880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 441/860] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:50 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:52.080197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:52.080842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:52.087057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:52.088005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:52.088810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:52.089250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:52.146387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:52.154133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1b4286dd-b693-47b6-9b51-110916a24afe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077783 Mar 08 19:56:52.154691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 420/861] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:52 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:53.171006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:53.171608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:53.177829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:53.178274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:53.179041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:53.179471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:53.240498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:53.248188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-01485a28-add0-4d0a-a070-5ea17c28bbb8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081108 Mar 08 19:56:53.248780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 442/862] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:53 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:54.264472 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:54.265083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:54.271399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:54.271871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:54.272663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:54.273098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:54.331830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:54.340594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2b64ecfc-0900-4503-8793-a5ae1d47bfdd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079224 Mar 08 19:56:54.340594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 421/863] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:54 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:55.356425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:55.357033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:55.363189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:55.363607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:55.364397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:55.364829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:55.424170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:55.431385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6a457d05-fcbf-44dd-a5e4-abb6ae24a3ad tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079175 Mar 08 19:56:55.431937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 443/864] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:55 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:56.446838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:56.447465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:56.453769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:56.454228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:56.455027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:56.455464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:56.517841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:56.525613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-22ef6376-2783-4e76-8745-80b0b7a03aab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082634 Mar 08 19:56:56.526171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 422/865] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:56 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:57.542905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:57.543471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:57.550103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:57.550558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:57.551337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:57.551779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:57.612193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:57.619440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-14c1e6f2-da1f-4afe-8fde-74966f8b3507 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081052 Mar 08 19:56:57.619993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 444/866] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:56:58.635882 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:56:58.636519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:56:58.642746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:58.643196 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:58.643959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:56:58.644434 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:56:59.098907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:56:59.108217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6b3fc1dc-416e-4600-88e2-02dfc47893a1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.476703 Mar 08 19:56:59.108821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 423/867] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:56:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:00.125782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:00.126399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:00.132686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:00.133130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:00.133899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:00.134849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:00.192833 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:00.200679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ec1f1804-cd0d-4838-8849-2a82c6163632 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078735 Mar 08 19:57:00.201236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 445/868] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:01.217589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:01.218171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:01.224397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:01.224849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:01.225606 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:01.226037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:01.283584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:01.291424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bc5eddc7-1981-41be-8d9d-033d4e7f3c4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077746 Mar 08 19:57:01.291979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 424/869] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:01 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:57:02.308439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:02.308973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:02.315116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:02.315559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:02.316342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:02.316776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:02.376437 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:02.383864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0780a185-0665-4bfc-b39d-b30ad2968503 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079913 Mar 08 19:57:02.384439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 446/870] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:02 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:03.400438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:03.401051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:03.407574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:03.408014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:03.408809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:03.409250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:03.466298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:03.473586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-da10390d-da2c-4e47-8384-2edd5e5467f0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077557 Mar 08 19:57:03.474143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 425/871] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:04.490925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:04.491531 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:04.498451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:04.498904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:04.499668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:04.500106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:04.558371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:04.565754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ffe6c826-6a1a-41cb-8ae3-f368650eedca tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078653 Mar 08 19:57:04.566324 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 447/872] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:04 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:05.582337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:05.582947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:05.589651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:05.590093 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:05.590848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:05.591273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:05.648841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:05.656581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-21246555-27d4-4404-9965-5a994a6fb8f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078066 Mar 08 19:57:05.657387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 426/873] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:05 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:06.673739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:06.674359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:06.680886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:06.681345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:06.682127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:06.682569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:06.745517 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:06.752811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b23ede62-4ae8-44ff-aa27-60d79ec252bb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082961 Mar 08 19:57:06.753376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 448/874] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:06 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:07.769027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:07.769645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:07.775611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:07.776068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:07.776872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:07.777308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:07.837609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:07.844897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-870d3e8b-59a1-44fb-8224-c6a53a677e57 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079774 Mar 08 19:57:07.845451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 427/875] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:07 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:08.861522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:08.862139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:08.868590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:08.869064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:08.869843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:08.870283 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:08.928464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:08.935797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d35b0993-524d-4988-8577-f41edfd79dfd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078179 Mar 08 19:57:08.936375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 449/876] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:08 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:09.952375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:09.952989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:09.959178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:09.959624 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:09.960413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:09.960852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:10.023602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:10.032401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c81e0479-329f-4952-bddf-4e66c43e9729 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083587 Mar 08 19:57:10.032960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 428/877] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:11.050984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:11.051578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:11.058141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:11.058591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:11.059365 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:11.059811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:11.117611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:11.124936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-18bfb8b9-2d29-4117-8d95-2d028ae61880 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079073 Mar 08 19:57:11.125497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 450/878] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:12.142055 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:12.142629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:12.148905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:12.149863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:12.150615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:12.151044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:12.252831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:12.260128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-66b860c2-5d2d-445f-902a-943147c59c06 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.121983 Mar 08 19:57:12.260693 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 429/879] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:12 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:13.276332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:13.276874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:13.283898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:13.284736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:13.286054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:13.286861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:13.390630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:13.397862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-db6a0fdf-0f71-44b6-a60c-cf70f14825d9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.125414 Mar 08 19:57:13.398421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 451/880] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:14.415498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:14.415914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:14.422335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:14.422779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:14.423544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:14.423992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:14.482429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:14.489721 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dde37ec3-17c9-48b6-917c-e3c4c70de3c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078708 Mar 08 19:57:14.490269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 430/881] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:14 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:15.506170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:15.506781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:15.513669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:15.514120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:15.514887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:15.515324 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:15.573799 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:15.581030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-79ba9163-f1d0-40ab-8cce-046ca9fc0191 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078680 Mar 08 19:57:15.581593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 452/882] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:15 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:16.597407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:16.598011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:16.605193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:16.605648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:16.606424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:16.606865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:16.669336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:16.676683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e3dd35dc-3e81-43e4-9374-be850bbc9594 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083089 Mar 08 19:57:16.677231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 431/883] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:16 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:17.693007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:17.693643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:17.700077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:17.700554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:17.701330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:17.701761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:17.760404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:17.767548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4b7773d6-b9f9-4d1f-940f-e9502c09bbff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078318 Mar 08 19:57:17.768110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 453/884] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:17 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:18.785143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:18.785747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:18.792428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:18.792874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:18.793640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:18.794072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:18.851942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:18.859833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6fb5c100-30e8-4296-9207-cc8d07aeb876 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078825 Mar 08 19:57:18.860397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 432/885] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:18 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:19.876695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:19.877992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:19.884543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:19.885039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:19.885900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:19.886399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:19.950927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:19.958261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1bc45993-2cb6-475c-8f4a-89a77fe4268f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085561 Mar 08 19:57:19.958822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 454/886] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:19 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:20.975038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:20.975646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:20.981877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:20.982327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:20.983089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:20.983526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:21.044448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:21.051710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-83265031-a14a-4ddb-884b-61cee1a35387 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080538 Mar 08 19:57:21.052271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 433/887] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:20 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:22.068096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:22.068753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:22.075403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:22.075849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:22.076774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:22.077222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:22.135119 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:22.142388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7a081de5-bc69-4328-b401-c3071a3ec130 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078054 Mar 08 19:57:22.142945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 455/888] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:22 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:23.159334 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:23.159876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:23.166637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:23.167089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:23.167857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:23.168322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:23.225267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:23.232900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a422006f-a8eb-4ec3-acd3-3cb0402f9231 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077732 Mar 08 19:57:23.233461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 434/889] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:23 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:23.422371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:57:23.422876 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 19:57:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:57:24.249878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:24.250426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:24.256774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:24.257224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:24.258020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:24.259048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:24.316741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:24.324787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-de5d7505-3ab4-4eeb-8ea6-c68ae72c73bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078856 Mar 08 19:57:24.325345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 456/890] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:25.341261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:25.341872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:25.348174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:25.348651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:25.349417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:25.349847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:25.410678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:25.418322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-88cdb97d-c551-4860-b9fe-496d83b042d0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081754 Mar 08 19:57:25.418901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 435/891] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:26.434643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:26.435242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:26.445708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:26.446778 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:26.447544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:26.448056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:26.506596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:26.514323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-06f264f5-fb4a-4b46-9315-2e9d0e91c5f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.084034 Mar 08 19:57:26.514868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 457/892] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:27.530964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:27.531602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:27.538157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:27.538610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:27.539380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:27.540452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:27.608732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:27.616319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c66081d3-54c9-4d34-a055-61ffcf58acd3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.089257 Mar 08 19:57:27.616866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 436/893] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:27 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:28.632810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:28.633986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:28.640363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:28.640818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:28.641621 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:28.642090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:28.701673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:28.708997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-435a440d-e006-4baf-9e73-2f298a188537 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080046 Mar 08 19:57:28.709555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 458/894] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:28 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:29.724682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:29.725299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:29.732109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:29.732591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:29.733363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:29.733810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:29.792004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:29.799213 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5277844b-3081-4805-8576-ef866ed3719a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078302 Mar 08 19:57:29.799772 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 437/895] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:30.814763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:30.815377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:30.821685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:30.822136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:30.822906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:30.823338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:30.880953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:30.888132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-907a02fe-6bdf-4e23-a6c7-fcea563bb115 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077178 Mar 08 19:57:30.888725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 459/896] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:30 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:31.904567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:31.905202 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:31.911610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:31.912058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:31.912858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:31.913293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:31.970914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:31.978148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-01629881-ebd5-4fd7-8266-28b5bb8547d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077391 Mar 08 19:57:31.978704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 438/897] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:31 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:32.994377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:32.994982 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:33.001134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:33.001577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:33.002338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:33.002767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:33.064961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:33.072745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-77904a19-6b07-4793-9831-4b6e57551035 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082094 Mar 08 19:57:33.073303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 460/898] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:32 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:33.187826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:57:33.188377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 19:57:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:57:34.088540 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:34.089157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:34.095341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:34.095797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:34.096603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:34.097051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:34.155039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:34.162488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c6d714c9-153b-453f-aaac-2120a4b16cc6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078271 Mar 08 19:57:34.163067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 439/899] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:35.178888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:35.179496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:35.186413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:35.186862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:35.187627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:35.188061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:35.246641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:35.253857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-54e4907b-a3ca-4a4f-b3f6-7e4f17a06d0a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078808 Mar 08 19:57:35.254548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 461/900] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:36.270559 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:36.271107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:36.278249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:36.278700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:36.279477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:36.279951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:36.338019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:36.345170 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-550e827f-0e73-47d0-a56b-184dc5c7b8d7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078620 Mar 08 19:57:36.345727 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 440/901] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:37.362694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:37.363302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:37.369587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:37.370034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:37.370802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:37.371236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:37.429362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:37.436596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-abb3c5bf-d4f5-4b30-bb47-18f3512fe698 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077683 Mar 08 19:57:37.437150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 462/902] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:38.453033 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:38.453703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:38.459783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:38.460236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:38.461043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:38.462000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:38.524589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:38.532393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-065d6967-3060-4b05-9f9e-a558cbd4ae29 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083188 Mar 08 19:57:38.532955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 441/903] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:39.549104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:39.549724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:39.556729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:39.557209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:39.557980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:39.558416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:39.617491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:39.625592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4954af4b-7fe4-4921-9187-91acd8b112d2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080358 Mar 08 19:57:39.626137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 463/904] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:39 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:40.642149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:40.642759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:40.649695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:40.650147 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:40.650914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:40.651354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:40.714602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:40.721820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-74c1ad9b-f768-47b0-be58-024279cb2927 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083548 Mar 08 19:57:40.722374 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 442/905] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:41.738563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:41.739178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:41.746066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:41.746526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:41.747291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:41.747734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:41.807597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:41.814916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ac53cc12-97d3-42cf-93ac-d82532082982 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080209 Mar 08 19:57:41.815468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 464/906] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:42.830840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:42.831444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:42.838282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:42.838736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:42.839579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:42.840014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:42.901215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:42.908767 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-85ed6e6d-70e9-4966-be1e-1bf271bae725 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081788 Mar 08 19:57:42.909324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 443/907] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:43.925072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:43.925694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:43.932638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:43.933097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:43.933872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:43.934313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:43.992053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:43.999819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fed2c721-4a82-4fa7-93dd-d6ec455a7652 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078557 Mar 08 19:57:44.000403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 465/908] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:44.513391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:57:44.513608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 19:57:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:57:45.016734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:45.017347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:45.023636 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:45.024090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:45.024887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:45.025328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:45.083486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:45.090839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ded3f29f-5892-4e7e-91ec-dc8ce6ec6843 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077960 Mar 08 19:57:45.091397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 444/909] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:46.109953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:46.109953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:46.114540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:46.114995 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:46.115772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:46.116407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:46.181648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:46.188934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fb0c9e27-7e41-4b53-8e42-4e8100299255 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085298 Mar 08 19:57:46.189480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 466/910] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:47.206660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:47.207318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:47.213876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:47.214333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:47.215105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:47.215546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:47.273934 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:47.281294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7493f485-d70f-4e8e-9c1e-9237128f1477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078473 Mar 08 19:57:47.282119 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 445/911] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:57:48.298361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:48.298958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:48.305641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:48.306030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:48.306782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:48.307207 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:48.365033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:48.372826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4eab37d8-78d1-4eb1-a1c8-c580b1fae804 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078233 Mar 08 19:57:48.373376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 467/912] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:49.389747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:49.390295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:49.396526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:49.396976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:49.397740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:49.398175 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:49.455581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:49.463271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-28fdf2b0-c64d-40be-a0f8-9e19a4ef802f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077419 Mar 08 19:57:49.464039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 446/913] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:50.478909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:50.479514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:50.485425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:50.485877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:50.486644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:50.487080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:50.545471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:50.552726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b23961a1-2057-4f69-836e-47928af62614 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077747 Mar 08 19:57:50.553289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 468/914] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:50 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:51.569751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:51.570870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:51.577078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:51.577527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:51.578292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:51.578729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:51.636875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:51.644100 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7acaf7e7-4b21-412c-99e3-37cd9a56cd91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078166 Mar 08 19:57:51.644683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 447/915] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:51 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:52.661628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:52.662161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:52.668456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:52.668902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:52.669665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:52.670096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:52.728448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:52.735574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-72f72acb-8a8a-4705-9775-0d0dd87789a3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077924 Mar 08 19:57:52.736127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 469/916] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:52 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:53.752644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:53.753168 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:53.759954 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:53.760429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:53.761179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:53.761612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:53.823703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:53.831132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-17081f6b-803f-43f4-b62c-71169e48fa45 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082449 Mar 08 19:57:53.831708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 448/917] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:53 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:54.847089 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:54.847705 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:54.854031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:54.854485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:54.855307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:54.855746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:54.914160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:54.921423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9df161c5-9dfb-47e6-8630-60d96252bf7d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078152 Mar 08 19:57:54.921963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 470/918] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:54 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:55.939115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:55.939724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:55.946052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:55.946505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:55.947286 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:55.947732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:56.006906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:56.014597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c0de0450-c68b-44a0-b3c8-ed8426bc1e46 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079446 Mar 08 19:57:56.015153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 449/919] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:55 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:57.031130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:57.032007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:57.038322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:57.038773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:57.039573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:57.040014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:57.097989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:57.105246 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c4cafc51-f270-4618-9192-f74ad829ec25 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077996 Mar 08 19:57:57.105811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 471/920] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:58.121748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:58.122357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:58.128632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:58.129082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:58.129841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:58.130272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:58.191393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:58.198649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4e096610-cc91-44cb-b273-c5dc180c02de tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080727 Mar 08 19:57:58.199204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 450/921] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:57:59.214843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:57:59.215425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:57:59.221647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:59.222118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:59.222874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:57:59.223305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:57:59.284624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:57:59.292351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6f079dfe-b5a8-457f-9c12-c29d8da11dd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081239 Mar 08 19:57:59.292835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 472/922] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:57:59 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:00.308501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:00.309138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:00.315396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:00.315850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:00.316652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:00.317099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:00.374695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:00.381940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-85522d8d-be63-4147-8c02-c6a41fbdffe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077356 Mar 08 19:58:00.382538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 451/923] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:01.398503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:01.399065 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:01.405298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:01.405742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:01.406765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:01.407196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:01.466366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:01.473706 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-432771da-091a-4ffc-84d4-70d2b8ba5a19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079116 Mar 08 19:58:01.474252 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 473/924] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:01 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:02.490737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:02.491351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:02.498163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:02.498640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:02.499410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:02.499850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:02.558001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:02.565144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1d790bdb-dfe8-4212-8c3c-bf32e55928d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078263 Mar 08 19:58:02.565701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 452/925] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:02 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:03.582460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:03.583074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:03.589967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:03.590418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:03.591187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:03.591620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:03.649509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:03.656942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a9c05d4d-2e0c-4929-873c-4b0479960567 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078065 Mar 08 19:58:03.657503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 474/926] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:04.673321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:04.673932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:04.680199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:04.680703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:04.681483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:04.681925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:04.739486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:04.746715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9ba0665f-9d5e-402a-8e1c-3be05680d2ce tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077307 Mar 08 19:58:04.747281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 453/927] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:04 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:05.763891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:05.764569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:05.770763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:05.771214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:05.771997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:05.772446 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:05.830424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:05.837680 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7e4c44b3-9337-4aeb-ba90-1d39cf06923b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077667 Mar 08 19:58:05.838234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 475/928] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:05 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:06.854756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:06.855358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:06.861242 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:06.861684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:06.862433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:06.862861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:06.924431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:06.933398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-567aad8c-2cec-47bb-b942-6f82c86dcbc3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081218 Mar 08 19:58:06.933398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 454/929] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:06 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:07.948664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:07.949274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:07.955739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:07.956015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:07.956811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:07.957248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:08.016914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:08.024417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6f60f2ed-eb0f-4022-b6be-e0de72c11b62 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080114 Mar 08 19:58:08.024983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 476/930] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:07 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:09.041075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:09.041693 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:09.047932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:09.048490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:09.049268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:09.049707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:09.108118 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:09.116139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f4a23bbf-9b90-4444-bb0a-059462c38462 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078891 Mar 08 19:58:09.116751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 455/931] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:10.131892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:10.132538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:10.138997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:10.139474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:10.140243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:10.140698 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:10.199428 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:10.206719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-75f552a5-3348-48ef-9e48-081e8c23e506 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078617 Mar 08 19:58:10.207298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 477/932] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:10 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:11.222820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:11.223567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:11.230527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:11.230977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:11.231748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:11.232186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:11.299564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:11.309341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-84095e50-eaee-4e16-893b-9afda4e52406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.090390 Mar 08 19:58:11.309906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 456/933] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:12.326503 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:12.327127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:12.333346 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:12.333799 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:12.334569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:12.335004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:12.396457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:12.403811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c79c1f8f-32ff-4452-88e8-6d51a729944e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081117 Mar 08 19:58:12.404392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 478/934] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:12 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:13.420752 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:13.421314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:13.427427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:13.427873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:13.428666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:13.429101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:13.486851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:13.494251 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-84aa44b8-3666-40ac-a7e4-cf9f2bd11424 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077389 Mar 08 19:58:13.494802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 457/935] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:14.512904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:14.513824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:14.521493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:14.521941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:14.522722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:14.523157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:14.584926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:14.592676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4e019c8b-53b2-4b39-aaa5-1bc0453c4ba8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085341 Mar 08 19:58:14.593235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 479/936] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:14 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:15.608936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:15.609593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:15.615860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:15.616250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:15.617641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:15.618075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:15.675257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:15.683142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b969413a-e696-4b7e-8d30-044e38e09f61 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078048 Mar 08 19:58:15.683699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 458/937] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:15 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:16.700387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:16.700961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:16.707230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:16.707682 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:16.708487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:16.708927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:16.766986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:16.774238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c1a9edbd-681f-48a8-9cb0-df922d5d20bc tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077926 Mar 08 19:58:16.774787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 480/938] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:16 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:17.791448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:17.791973 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:17.798351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:17.798799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:17.799564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:17.799998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:17.857373 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:17.864485 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fb6cd488-eaa0-4343-801a-375eb244c6e9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077408 Mar 08 19:58:17.865042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 459/939] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:17 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:18.881687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:18.882296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:18.889027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:18.889473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:18.890234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:18.890668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:18.950359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:18.957870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9cb7e663-716b-45b7-8e31-f4f9c42f435a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080039 Mar 08 19:58:18.958432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 481/940] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:18 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:19.975092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:19.975545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:19.983015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:19.983557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:19.984452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:19.984797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:20.060039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:20.067484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-301885ed-3075-442b-872d-d3c2a3d731e3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.096480 Mar 08 19:58:20.068054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 460/941] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:19 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:21.084743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:21.085358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:21.091351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:21.091802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:21.092597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:21.093036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:21.152230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:21.159804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-681258fc-4fe2-44c1-b4d0-6d9e54d1c5c1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078882 Mar 08 19:58:21.160383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 482/942] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:21 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:22.177209 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:22.177817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:22.184615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:22.185069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:22.185833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:22.186273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:22.244823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:22.252072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c012c4bf-3ffe-4543-a71a-e63a5286f7b5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078680 Mar 08 19:58:22.252664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 461/943] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:22 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:23.268669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:23.269278 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:23.275606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:23.276061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:23.276862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:23.277302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:23.336265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:23.344134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-80a65c29-792a-4855-9976-a784dbb0abee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079351 Mar 08 19:58:23.344716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 483/944] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:23 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:58:24.362996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:24.363605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:24.370512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:24.370960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:24.371733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:24.372195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:24.433376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:24.440667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-469a8ed8-1383-429a-827e-a19a1e768c30 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081535 Mar 08 19:58:24.441227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 462/945] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:25.458036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:25.458697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:25.465511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:25.465949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:25.466701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:25.467130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:25.532414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:25.539656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-70ed6385-2edc-4cdf-82d9-45f24fd2264c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085607 Mar 08 19:58:25.540212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 484/946] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:26.556142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:26.556780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:26.563105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:26.563555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:26.564341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:26.564779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:26.622438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:26.629716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-af36c8e2-bb46-4e9b-9c4c-ee56bf2deaae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077435 Mar 08 19:58:26.630269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 463/947] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:27.646544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:27.647177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:27.653893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:27.654400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:27.655177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:27.655616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:27.714074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:27.721287 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4d728aa6-bcce-4f30-aef5-5c3ed44abcae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078607 Mar 08 19:58:27.721847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 485/948] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:27 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:28.737904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:28.738478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:28.744744 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:28.745201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:28.745970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:28.746404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:28.804162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:28.811464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d1e761de-fb29-4531-b627-61692a455b7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077530 Mar 08 19:58:28.812018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 464/949] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:28 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:29.828525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:29.829144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:29.835454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:29.835903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:29.836713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:29.837154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:29.897193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:29.905083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bf0a6f18-42d7-4aff-846f-4d79b4dca1d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081002 Mar 08 19:58:29.905653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 486/950] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:30.921852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:30.922461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:30.928790 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:30.929236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:30.930012 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:30.930429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:30.992152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:31.008589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0b8cbb39-2ef4-4b6a-812b-7e1f75c2c802 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.090492 Mar 08 19:58:31.009165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 465/951] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:30 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:32.029242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:32.029856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:32.036059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:32.036539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:32.037305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:32.037739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:32.103633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:32.111751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f9d0b677-3730-42ce-b4cd-7f2686c76550 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.086167 Mar 08 19:58:32.112355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 487/952] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:32 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:33.128521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:33.129261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:33.135452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:33.135904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:33.136706 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:33.137146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:33.196533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:33.204524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f57bb239-d4ca-47dc-9adf-2ad55f6a5820 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079828 Mar 08 19:58:33.205073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 466/953] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:33 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:34.221287 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:34.221897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:34.228109 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:34.228594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:34.229366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:34.229809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:34.288214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:34.295560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bf29aa5c-569a-4e20-927e-855da584eb7a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078076 Mar 08 19:58:34.296128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 488/954] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:35.311838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:35.312481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:35.318707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:35.319158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:35.319923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:35.320384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:35.379733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:35.386968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2b994ca8-c4ac-48e9-871e-95167fb00952 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079015 Mar 08 19:58:35.387526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 467/955] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:36.403158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:36.403711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:36.411349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:36.411811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:36.412613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:36.413056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:36.473165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:36.480378 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-27605fdc-970f-4526-9a21-ee69655ef21d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081097 Mar 08 19:58:36.480936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 489/956] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:37.497249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:37.498449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:37.504393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:37.504852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:37.505623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:37.506064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:37.563568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:37.570867 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1d6ee7cc-fc69-48e1-8fa1-f54368193086 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077898 Mar 08 19:58:37.571428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 468/957] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:38.586859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:38.587462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:38.593654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:38.594098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:38.594855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:38.595283 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:38.657496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:38.664844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-63611287-3237-485c-9d1e-a67c3d384eae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081867 Mar 08 19:58:38.665412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 490/958] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:39.680933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:39.681497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:39.687752 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:39.688202 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:39.689009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:39.689449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:39.749653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:39.756916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-770301d3-cbf8-4e36-b3ac-a00f79fc45df tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079988 Mar 08 19:58:39.757473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 469/959] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:39 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:40.774363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:40.774899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:40.781527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:40.781975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:40.782770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:40.783203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:40.842695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:40.850013 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4daf2a63-159c-4309-a32c-5060e05c0ca1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079564 Mar 08 19:58:40.850568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 491/960] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:41.867088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:41.867673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:41.873959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:41.874400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:41.875157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:41.875585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:41.933949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:41.941933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-77b7502e-e724-4010-8756-0b100cb59c1f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078687 Mar 08 19:58:41.942496 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 470/961] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:42.959350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:42.959957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:42.966225 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:42.966675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:42.967438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:42.967873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:43.025925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:43.033350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7b036de5-801d-4458-97c6-ce2c98879cd8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077878 Mar 08 19:58:43.033913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 492/962] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:44.050135 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:44.050758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:44.057123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:44.057571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:44.058337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:44.058773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:44.121391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:44.129315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a3cd034a-9791-45ea-a673-dca413a9aab4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083033 Mar 08 19:58:44.129877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 471/963] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:44 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:45.145798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:45.146410 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:45.153782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:45.153782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:45.154067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:45.154674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:45.214420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:45.222099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-20071e9a-0f75-418c-a89c-3bbb8a71072f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080157 Mar 08 19:58:45.222653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 493/964] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:46.238618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:46.239220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:46.245436 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:46.245881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:46.246928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:46.247364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:46.305551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:46.313401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cc100b54-6135-4071-982f-e7fb326c034a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079098 Mar 08 19:58:46.314084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 472/965] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:47.330103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:47.330712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:47.337079 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:47.337529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:47.338319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:47.338751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:47.397427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:47.404718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-17541b45-ef29-4f2b-853b-750e46d295db tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078438 Mar 08 19:58:47.405265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 494/966] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:48.422639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:48.423190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:48.429403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:48.429847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:48.430610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:48.431040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:48.489519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:48.496675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c438f957-b5c5-473d-bc52-8d45069e606b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078186 Mar 08 19:58:48.497225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 473/967] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:58:49.512914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:49.513466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:49.520311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:49.520777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:49.521548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:49.521983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:49.582271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:49.589485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bbb8e1ba-1de9-43a6-b65f-3680d9988566 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080527 Mar 08 19:58:49.590052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 495/968] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:50.606250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:50.606857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:50.613111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:50.613557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:50.614319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:50.614754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:50.672743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:50.679930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-34dfb8c7-e5b0-49e6-984a-06ddd07e1f7e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077570 Mar 08 19:58:50.680517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 474/969] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:50 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:50.914241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:50.914733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:50.920700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:50.921088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:50.921845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:50.922278 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:50.996496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lazy-loading 'services' on Instance uuid cf15cfb8-7c73-418b-b268-1fc064fc717f {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:58:51.064901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6d78d645-0321-4368-b033-601a9cc182d5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f/os-volume_attachments/f1c34a5f-2afa-4c67-8a57-36b6f29f17a2" status: 202 len: 0 microversion: 2.1 time: 0.154319 Mar 08 19:58:51.065484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 496/970] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 19:58:50 2022] DELETE /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f/os-volume_attachments/f1c34a5f-2afa-4c67-8a57-36b6f29f17a2 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:58:51.696707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:51.697311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:51.703439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:51.703884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:51.704673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:51.705104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:51.762493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:51.771044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-27edb89b-a323-46c1-8265-aeefa33f85d5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078077 Mar 08 19:58:51.771606 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 475/971] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:51 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:52.788848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:52.789464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:52.795947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:52.796422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:52.797838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:52.798305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:52.863198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:52.870460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-283e700b-74a2-4739-b968-710c42041c83 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.086553 Mar 08 19:58:52.871013 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 497/972] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:52 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:53.044094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:58:53.044594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 19:58:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:58:53.886987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:53.887596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:53.893976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:53.894428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:53.895193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:53.895630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:53.954971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:53.962179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1c41feed-d82e-4d1d-9fc5-5931317b1520 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079093 Mar 08 19:58:53.962728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 476/973] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:53 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:54.979153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:54.979758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:54.986642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:54.987087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:54.987849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:54.988304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:55.045247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:55.052983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8fff249a-6c21-4f1a-af69-01cf52487a9c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077732 Mar 08 19:58:55.053539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 498/974] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:54 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:56.069488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:56.070115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:56.076334 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:56.076791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:56.077545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:56.077972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:56.139496 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:56.146924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fc904afa-7a24-403d-b8d4-325eb4ce692e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081292 Mar 08 19:58:56.147479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 477/975] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:56 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:57.163487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:57.164102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:57.170359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:57.170808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:57.172390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:57.172900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:57.238579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:57.245702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-236567eb-4e3c-455c-b4e5-9985a6aeaf91 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.086105 Mar 08 19:58:57.246272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 499/976] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:58.262381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:58.262996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:58.269402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:58.269852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:58.270613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:58.271048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:58.329300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:58.336456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-829c5945-634d-4f85-8d72-824d2e133905 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077893 Mar 08 19:58:58.337010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 478/977] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:58:59.353069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:58:59.353680 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:58:59.359997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:59.360493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:59.361266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:58:59.361703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:58:59.419664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:58:59.426927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-32366412-937f-4b6f-9672-e0521b5801ff tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077698 Mar 08 19:58:59.427489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 500/978] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:58:59 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:00.443562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:00.444262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:00.450503 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:00.450956 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:00.451738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:00.452177 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:00.526222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:00.533777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7073ee2c-3fab-428d-9e5f-8699bcbe83cd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.094210 Mar 08 19:59:00.534331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 479/979] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:01.550650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:01.551477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:01.558684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:01.559133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:01.559929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:01.560389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:01.618753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:01.626785 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d2f5559e-fffa-48e7-b734-05266a85baf7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079575 Mar 08 19:59:01.627349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 501/980] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:01 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:59:02.643193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:02.643718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:02.650116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:02.650568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:02.651337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:02.651779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:02.709903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:02.717218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0ca7d473-d687-43c6-b921-5d44a062e3f4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077966 Mar 08 19:59:02.717773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 480/981] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:02 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:03.734198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:03.734936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:03.741321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:03.741774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:03.742570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:03.743136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:03.802078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:03.809348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b4552daf-22db-4de0-bfd2-219d6e6f8987 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079386 Mar 08 19:59:03.809918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 502/982] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:04.826515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:04.827131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:04.833535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:04.833991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:04.834760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:04.835197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:04.894008 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:04.901224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-74cd82fe-a64c-4a2f-941e-69c733c5dc71 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078626 Mar 08 19:59:04.901772 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 481/983] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:04 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:05.918255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:05.918861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:05.925168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:05.925616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:05.926382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:05.926815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:05.988556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:05.995862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-396b5323-2642-4e25-9702-f5d7b376c753 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081510 Mar 08 19:59:05.996447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 503/984] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:05 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:07.012876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:07.013490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:07.019928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:07.020397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:07.021153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:07.021584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:07.080603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:07.087664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3b85ef78-9f26-48f6-8150-19fb3a8429ed tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078637 Mar 08 19:59:07.088216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 482/985] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:07 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:08.103530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:08.104204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:08.110972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:08.111429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:08.112209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:08.113075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:08.171373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:08.179177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d234da7c-e110-4bd5-83a3-a15445d06517 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079536 Mar 08 19:59:08.179728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 504/986] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:08 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:09.195551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:09.196171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:09.202463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:09.202914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:09.204350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:09.204795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:09.264908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:09.272720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a2953cf0-1d7c-4b76-8a1b-df5f7dfb997f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081079 Mar 08 19:59:09.273274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 483/987] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:10.290033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:10.290672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:10.297043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:10.297494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:10.298264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:10.298704 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:10.356712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:10.364006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c8b167b1-a5b6-4391-b74c-97b7930ce317 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077778 Mar 08 19:59:10.364536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 505/988] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:10 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:10.751275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:59:10.752330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 19:59:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:59:11.380538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:11.381088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:11.387322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:11.387775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:11.388582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:11.389022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:11.449868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:11.457206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f4063fa3-474d-482f-bada-3d845fa5df94 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080683 Mar 08 19:59:11.457768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 484/989] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:12.473924 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:12.474605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:12.480901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:12.481352 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:12.482128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:12.482582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:12.543833 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:12.551561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-461137bf-4f5e-43b1-b9b3-d39bd3122d6a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081570 Mar 08 19:59:12.552113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 506/990] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:12 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:13.568735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:13.569353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:13.575554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:13.576005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:13.576799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:13.577239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:13.634716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:13.641954 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d129a146-feb7-427f-8781-43429e706d0e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077121 Mar 08 19:59:13.643286 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 485/991] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:14.662000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:14.662719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:14.668974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:14.669420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:14.670186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:14.670619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:14.728957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:14.736137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-31f6d46c-5d01-4cb6-8a00-25bb8a2256e4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078627 Mar 08 19:59:14.736726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 507/992] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:14 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:15.753021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:15.753618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:15.759892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:15.760355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:15.761113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:15.761542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:15.819185 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:15.826342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b08ded0d-6656-4426-bd27-fac84acd54c6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077669 Mar 08 19:59:15.826890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 486/993] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:15 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:16.845366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:16.845981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:16.852316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:16.852769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:16.853540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:16.853984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:16.912361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:16.919493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d53ce1e6-5cbc-40dc-944f-2432510f699a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077996 Mar 08 19:59:16.920054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 508/994] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:16 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:17.936683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:17.937296 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:17.943610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:17.944062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:17.944859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:17.945297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:18.009400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:18.017921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7a40f175-be68-4e0e-93c2-63b7353983d3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085102 Mar 08 19:59:18.018484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 487/995] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:17 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:18.944244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:59:18.944787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 19:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:59:19.037501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:19.038113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:19.044411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:19.044867 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:19.045639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:19.046083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:19.107716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:19.115169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e580b894-38b3-4b23-acae-20d76446dba4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081957 Mar 08 19:59:19.115730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 509/996] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:19 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:20.130883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:20.131517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:20.137821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:20.138267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:20.139030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:20.139464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:20.198859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:20.206063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bab1f287-93ac-402f-bf0e-698ef37655a5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079033 Mar 08 19:59:20.206628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 488/997] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:20 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:21.222702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:21.223343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:21.229320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:21.229775 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:21.230552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:21.230990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:21.296725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:21.305030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1027b7e2-9ae7-474e-9d03-e8b844b3b801 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.086303 Mar 08 19:59:21.305612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 510/998] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:21 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:22.322200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:22.322803 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:22.329116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:22.329564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:22.330327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:22.330759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:22.388597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:22.396395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b6842b02-6b71-416c-8e02-5db03b3ec659 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078028 Mar 08 19:59:22.396952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 489/999] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:22 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:23.413125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:23.413661 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:23.419869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:23.420353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:23.421128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:23.421565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:23.479964 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:23.487296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-25677b28-7f2a-44bd-9892-368bba819a6c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078182 Mar 08 19:59:23.488441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 511/1000] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:23 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:24.504560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:24.505166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:24.511422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:24.511869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:24.512659 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:24.513093 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:24.573249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:24.580447 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-86b5bd3c-9c6b-4e19-a68e-15c3ce801309 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079783 Mar 08 19:59:24.581004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 490/1001] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:25.597449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:25.598060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:25.605085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:25.605543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:25.606312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:25.606753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:25.665721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:25.672933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2a7bca1c-534c-4063-a441-a8e086de9e95 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079357 Mar 08 19:59:25.673525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 512/1002] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:26.690122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:26.690730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:26.697681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:26.698132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:26.698903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:26.699340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:26.757003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:26.764192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-efbe70b5-0012-41b5-a3b7-b2bbbe91c5f7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077898 Mar 08 19:59:26.764787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 491/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:27.780099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:27.780970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:27.787633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:27.788076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:27.788871 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:27.789303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:27.849311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:27.856550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2e277ed8-6e78-4d7d-83a5-d5e443086887 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080310 Mar 08 19:59:27.857096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 513/1004] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:27 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:28.874029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:28.874639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:28.882038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:28.882492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:28.883304 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:28.884054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:28.947768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:28.955003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fe3e6bac-ef12-493d-9e6e-53ad5ddd8d2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.084849 Mar 08 19:59:28.955560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 492/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:28 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:29.971539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:29.972070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:29.978421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:29.978873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:29.979645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:29.980081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:30.038172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:30.045319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b76310fc-f712-49c8-9432-aafb01f2848d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077742 Mar 08 19:59:30.045882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 514/1006] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:31.062014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:31.062643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:31.073771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:31.074618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:31.075471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:31.075918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:31.155411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:31.163766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8526d014-2ca8-4fd1-8b6a-97be89936c3b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.105608 Mar 08 19:59:31.164374 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 493/1007] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:31 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:32.180843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:32.181451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:32.187644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:32.188100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:32.188893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:32.189329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:32.250564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:32.257783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c85315ca-a111-492c-802d-8c4edf75454a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081346 Mar 08 19:59:32.258337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 515/1008] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:32 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:33.273820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:33.274426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:33.281237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:33.281691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:33.282466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:33.282907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:33.340640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:33.347763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8ec14b9e-a82a-4427-bde5-4cd17d546ab6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077827 Mar 08 19:59:33.348338 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 494/1009] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:33 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:34.364348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:34.364884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:34.371139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:34.371589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:34.372381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:34.372815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:34.431343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:34.438573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d6c995e0-e178-473c-b68b-7022d2bd9b37 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078153 Mar 08 19:59:34.439126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 516/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:35.455549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:35.456079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:35.462876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:35.463320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:35.464078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:35.464546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:35.524640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:35.532029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-08edab9d-243e-4be5-b24f-57533edd7f2c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080417 Mar 08 19:59:35.532652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 495/1011] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:36.549431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:36.550042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:36.557124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:36.557576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:36.558375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:36.558819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:36.616575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:36.623893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-de5e7799-d973-478a-bba5-a10d0b2977cf tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078293 Mar 08 19:59:36.624493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 517/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:37.640683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:37.641322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:37.647870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:37.648341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:37.649111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:37.649549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:37.707100 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:37.714273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-23d84d09-74cc-439c-a825-7f2331b5cce8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077420 Mar 08 19:59:37.714832 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 496/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:38.730727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:38.731344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:38.737689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:38.738083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:38.738852 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:38.739287 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:38.797924 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:38.805149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-976bf1ec-c12a-44e1-a55d-ad31dbd2d42a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078268 Mar 08 19:59:38.805707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 518/1014] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:39.821979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:39.822728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:39.829321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:39.829780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:39.830552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:39.830990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:39.888740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:39.895992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c3a433a5-2d7a-48cb-b0e3-3f61e18734f3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077904 Mar 08 19:59:39.896585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 497/1015] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:39 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:40.912464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:40.913067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:40.919391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:40.919831 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:40.920624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:40.921050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:40.980333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:40.987522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-87763de8-7bec-4de0-9fad-98ecdce0801c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078964 Mar 08 19:59:40.988076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 519/1016] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:42.007169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:42.007776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:42.016632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:42.017101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:42.017884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:42.018357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:42.076845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:42.084632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c89d6e55-3d50-4279-9e5b-66b71f4c337d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.083731 Mar 08 19:59:42.085201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 498/1017] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:43.101126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:43.101730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:43.108059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:43.108538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:43.109309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:43.109746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:43.167972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:43.175038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b6826bcb-c9da-4718-b029-c83237e4688d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077760 Mar 08 19:59:43.175589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 520/1018] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:44.192506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:44.193150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:44.199310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:44.199765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:44.200560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:44.201007 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:44.264214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:44.272242 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-14dceb7a-9a50-4ada-ad00-60f61dae6efd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.084158 Mar 08 19:59:44.272826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 499/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:44 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:45.289423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:45.290032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:45.296358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:45.296814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:45.297585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:45.298019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:45.359409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:45.366893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-118cdf3f-54cd-45cc-8d32-fb5900f72246 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081852 Mar 08 19:59:45.367391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 521/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:46.384386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:46.385075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:46.393350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:46.394056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:46.395929 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:46.396669 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:46.454333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:46.462089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1b5ed921-a964-4608-b86d-75357577cf99 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082743 Mar 08 19:59:46.462649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 500/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:47.479588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:47.480132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:47.486409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:47.486854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:47.487618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:47.488051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:47.546235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:47.553477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-59fe6a8e-c85a-4489-a42c-ff77232cbfab tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077893 Mar 08 19:59:47.554030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 522/1022] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:48.569860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:48.570463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:48.576699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:48.577142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:48.577891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:48.578318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:48.635993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:48.643184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f15e809c-3634-4d85-8a28-58c51d28063d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077184 Mar 08 19:59:48.643737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 501/1023] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:49.659767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:49.661509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:49.666778 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:49.667232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:49.668003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:49.668474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:49.727046 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:49.734441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-df0cf04e-7aa2-4582-ba29-4cd64fb64838 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078823 Mar 08 19:59:49.735023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 523/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:50.752162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:50.752764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:50.759344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:50.762426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:50.763231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:50.763680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:50.829998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:50.837971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6d089552-37f6-4296-bbd8-d91d6f065e4a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.090165 Mar 08 19:59:50.838528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 502/1025] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:50 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:51.855029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:51.855639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:51.861542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:51.861992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:51.862769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:51.863209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:51.923863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:51.931612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5240aad5-d390-441a-92f7-e96519abedec tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080953 Mar 08 19:59:51.932174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 524/1026] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:51 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:52.948162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:52.948779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:52.955040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:52.955494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:52.956263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:52.956726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:53.014489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:53.022164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-026b8d22-29f9-4484-a775-650cd95c16e7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077898 Mar 08 19:59:53.022726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 503/1027] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:52 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:54.039006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:54.039614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:54.045905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:54.046357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:54.047127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:54.047566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:54.105604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:54.112887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7fee90e2-261b-4175-bfd0-4d02f8c18d93 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077730 Mar 08 19:59:54.113457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 525/1028] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:54 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:55.129670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:55.130293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:55.136574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:55.137028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:55.137796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:55.138235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:55.195805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:55.203012 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6865b955-7c8e-49c4-bc17-a81ed3f8e477 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077401 Mar 08 19:59:55.203568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 504/1029] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:55 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:56.219747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:56.220419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:56.227474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:56.227926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:56.228716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:56.229152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:56.289349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:56.296564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-08deece5-410c-49c9-9506-dfc4a4038a4f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080657 Mar 08 19:59:56.297127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 526/1030] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:56 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:57.313673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:57.314277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:57.321206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:57.321649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:57.322403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:57.322830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:57.383479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:57.390658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bf85b3d2-a8be-49d3-aa03-169f70157106 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080791 Mar 08 19:59:57.391203 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 505/1031] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:58.406997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:58.407601 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:58.415195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:58.415646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:58.416435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:58.416870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:58.480692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:58.488174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2f3354a9-55fa-4ea0-84e4-17eea80e6ddd tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085541 Mar 08 19:59:58.488771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 527/1032] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:59:59.506129 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:59:59.506687 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:59:59.513148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:59.513592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:59.514346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:59:59.514775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:59:59.572553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:59:59.579632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7704424d-af9d-4817-a351-6130ae451889 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078088 Mar 08 19:59:59.580175 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 506/1033] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 19:59:59 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:00.596023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:00.596654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:00.603150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:00.603602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:00.604404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:00.604840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:00.663548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:00.670750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bacdd6a7-ede8-424f-9a6b-9d4f6f1ee87f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078610 Mar 08 20:00:00.671301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 528/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:01.687186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:01.687800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:01.694712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:01.695164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:01.695930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:01.696396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:01.753638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:01.762682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8ca827e8-a0d4-4c82-ba5a-052e096bf4f6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079199 Mar 08 20:00:01.763713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 507/1035] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:01 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:02.779708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:02.780231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:02.787315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:02.787772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:02.788573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:02.789014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:02.847103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:02.854804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-efd16591-252a-4568-a85b-8dc3dd77f542 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079077 Mar 08 20:00:02.855370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 529/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:02 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:03.870855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:03.871454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:03.877638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:03.878087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:03.878838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:03.879266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:03.941337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:03.949624 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5034d23d-ef0e-485c-8009-1938453bb0ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082635 Mar 08 20:00:03.950180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 508/1037] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:04.966400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:04.967136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:04.974060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:04.974509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:04.975281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:04.975724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:05.033408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:05.041097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-38fb2549-a3d4-448e-847e-9706c4e85c0b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078618 Mar 08 20:00:05.041646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 530/1038] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:04 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:06.058065 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:06.058670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:06.065021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:06.065476 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:06.066248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:06.066683 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:06.125313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:06.133168 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4de4991d-a97b-445e-8970-08f365512e51 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078989 Mar 08 20:00:06.133724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 509/1039] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:06 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:00:07.150199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:07.150807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:07.157308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:07.157757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:07.158520 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:07.158954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:07.216981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:07.224920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c04a08a5-af56-446e-8bd7-2d004449d96f tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078478 Mar 08 20:00:07.225497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 531/1040] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:07 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:08.332548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:08.333164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:08.338959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:08.339407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:08.340183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:08.340646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:08.398628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:08.406046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6af890b6-76d8-4f50-b86c-78e35a358fee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.168536 Mar 08 20:00:08.406597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 510/1041] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:08 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:09.422960 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:09.423523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:09.430400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:09.430843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:09.431603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:09.432030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:09.488997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:09.496670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3e9bf6ab-40de-4004-8b4c-ff94cf0aa7fe tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077677 Mar 08 20:00:09.497224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 532/1042] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:10.513501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:10.514108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:10.520379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:10.520835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:10.522312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:10.522748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:10.583393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:10.591269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fdc6ec69-4865-41e1-b447-ec3510085ef6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081648 Mar 08 20:00:10.591818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 511/1043] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:10 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:11.607770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:11.608488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:11.614659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:11.615104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:11.615863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:11.616320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:11.679269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:11.686566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-728a0dfd-26b7-4845-9961-0b159869c380 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082664 Mar 08 20:00:11.687126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 533/1044] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:11 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:12.702487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:12.703103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:12.709990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:12.710446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:12.711215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:12.711659 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:12.769245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:12.777098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4515c8d3-2a0a-4aa3-921a-366c8b154406 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078496 Mar 08 20:00:12.777661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 512/1045] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:12 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:13.794920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:13.795526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:13.801766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:13.802696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:13.803473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:13.803912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:13.861695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:13.869454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8e6d262e-cbca-40b7-8917-35a0d3ebc950 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078458 Mar 08 20:00:13.870016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 534/1046] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:13 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:14.886013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:14.886613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:14.892856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:14.893298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:14.894048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:14.894479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:14.952425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:14.959558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-23aee3f5-3715-4e9d-8a84-7f046526fb23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077390 Mar 08 20:00:14.960106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 513/1047] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:14 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:00:15.975144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:15.975750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:15.982073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:15.982526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:15.983290 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:15.983732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:16.045656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:16.052936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1a6137d4-833d-488f-82c2-8f071a857583 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081616 Mar 08 20:00:16.053498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 535/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:15 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:17.070380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:17.070992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:17.077275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:17.077728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:17.078491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:17.078929 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:17.137468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:17.144757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d4d3270b-f9c4-4e2b-9f0b-2cdd92b5261a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078691 Mar 08 20:00:17.145320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 514/1049] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:17 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:18.162114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:18.162729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:18.169028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:18.169480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:18.170255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:18.170695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:18.228607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:18.235855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-171ab447-f2ed-43c0-ad55-bd8b1a0def17 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077620 Mar 08 20:00:18.236431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 536/1050] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:18 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:19.252991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:19.253602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:19.260389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:19.260837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:19.261596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:19.262050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:19.321126 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:19.328237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5deeed71-0d39-4c61-9207-fe3e87149467 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079100 Mar 08 20:00:19.328823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 515/1051] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:19 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:20.345494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:20.346108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:20.351940 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:20.352428 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:20.353200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:20.353641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:20.411902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:20.419138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-77631101-1dde-439d-a8ac-f628f6d56fba tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077718 Mar 08 20:00:20.419698 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 537/1052] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:20 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:00:21.436204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:21.436801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:21.443172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:21.444153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:21.444963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:21.445406 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:21.506620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:21.513862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c507bcb4-4a52-43e9-8557-6937076da343 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081722 Mar 08 20:00:21.514419 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 516/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:21 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:22.531342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:22.531948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:22.538283 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:22.538740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:22.539514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:22.539952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:22.599978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:22.607347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-be93681b-b18e-4000-be1a-801eba43caa4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080201 Mar 08 20:00:22.607913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 538/1054] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:22 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:23.624315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:23.624933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:23.631783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:23.632224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:23.633002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:23.633429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:23.695243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:23.702461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-38ae1bfb-3f8c-471c-8c61-17af2f6ac78b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082012 Mar 08 20:00:23.703014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 517/1055] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:23 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:24.719972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:24.720613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:24.726824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:24.727289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:24.728034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:24.728563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:24.790903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:24.798228 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b08636ef-72e5-4b60-8d75-6fad189a642c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082119 Mar 08 20:00:24.798787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 539/1056] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:24 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:25.815211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:25.815824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:25.822520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:25.822974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:25.823742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:25.824182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:25.882039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:25.889227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cc61d3c5-0a13-4ceb-babd-a603c64ba4b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077912 Mar 08 20:00:25.889786 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 518/1057] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:25 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:26.905016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:26.905877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:26.912094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:26.912573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:26.913327 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:26.913755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:26.972670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:26.979740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d4860a98-961e-48a6-a4da-70df574c288e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078621 Mar 08 20:00:26.980315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 540/1058] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:26 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:27.996108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:27.996738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:28.003031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:28.003474 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:28.004228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:28.004684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:28.062662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:28.070237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4c559173-39e8-417f-9ea3-d7a295c66465 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078041 Mar 08 20:00:28.070783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 519/1059] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:27 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:29.087279 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:29.087879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:29.094159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:29.094604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:29.095361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:29.095789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:29.154048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:29.161487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4228b452-661d-4beb-9e00-5a0a511e9ece tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078109 Mar 08 20:00:29.162069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 541/1060] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:29 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:30.180493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:30.181104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:30.189625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:30.190356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:30.191565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:30.192238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:30.253488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:30.261157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-809e292b-7c23-4f2a-b038-c607f938ca4c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085528 Mar 08 20:00:30.261712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 520/1061] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:30 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:31.277714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:31.278351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:31.284632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:31.285092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:31.285864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:31.286304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:31.345966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:31.353949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c3054b59-0075-4fdb-9bea-34491078ea00 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080105 Mar 08 20:00:31.354449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 542/1062] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:31 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:32.370773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:32.371323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:32.378444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:32.378899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:32.379681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:32.380116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:32.444984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:32.452733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f0e28792-d507-449a-8525-9dadc67316b4 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085891 Mar 08 20:00:32.453304 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 521/1063] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:32 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:33.470073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:33.470587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:33.476816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:33.477256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:33.478010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:33.478442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:33.536900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:33.544163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0d2e5265-acdf-4fe5-a39b-78a2335b7f9e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078070 Mar 08 20:00:33.544752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 543/1064] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:33 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:34.560587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:34.561206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:34.567523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:34.567977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:34.569352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:34.569816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:34.628050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:34.635926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-51dcabdc-94d4-4a09-b334-8d09637eb29a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079283 Mar 08 20:00:34.636523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 522/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:34 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:35.652526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:35.653139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:35.659881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:35.660358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:35.661130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:35.661568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:35.719631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:35.727282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-92c99c02-6a86-461b-8f5f-f77bececc71b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078714 Mar 08 20:00:35.727835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 544/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:35 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:36.743430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:36.744035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:36.749926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:36.750370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:36.751125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:36.751551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:36.812229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:36.819939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7b1b2497-2b27-4a7f-8977-967f132c7a82 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080531 Mar 08 20:00:36.820515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 523/1067] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:36 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:37.836928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:37.837537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:37.843725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:37.844188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:37.844986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:37.845417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:37.907562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:37.915379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a8cf725a-18ae-4850-ab80-55de8b97896c tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082857 Mar 08 20:00:37.915936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 545/1068] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:37 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:38.931387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:38.931989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:38.938218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:38.938659 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:38.939411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:38.939869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:39.012232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:39.019617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2770911b-83ae-484e-a21c-40c45706a021 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.092592 Mar 08 20:00:39.020179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 524/1069] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:38 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:40.036452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:40.037117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:40.043367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:40.043821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:40.044631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:40.045075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:40.104414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:40.111696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1dab9fcb-6515-4d3e-b389-15149ee4085e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079167 Mar 08 20:00:40.112265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 546/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:40 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:41.128092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:41.128745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:41.135097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:41.135545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:41.136334 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:41.136774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:41.196912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:41.204195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c1ce26cb-cfb9-4131-b3f2-e48ef57c22e6 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079953 Mar 08 20:00:41.204806 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 525/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:41 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:42.221377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:42.221984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:42.228321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:42.228760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:42.229519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:42.229951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:42.288029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:42.295377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-30a69a13-8908-4189-9974-3b366abe41f5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077811 Mar 08 20:00:42.295932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 547/1072] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:42 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:43.313003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:43.313619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:43.320483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:43.320939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:43.321713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:43.322150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:43.386822 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:43.394078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f3ef32ea-4af9-4d5c-af60-4e5d698a77ef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.085002 Mar 08 20:00:43.394637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 526/1073] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:43 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:43.433188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:00:43.433678 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:00:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:00:44.411158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:44.411686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:44.418317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:44.418800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:44.419574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:44.420016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:44.478376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:44.485616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e3253cec-5400-4767-b6ac-ecca416b6a1a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078506 Mar 08 20:00:44.486174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 548/1074] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:44 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:45.502271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:45.502800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:45.509634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:45.510085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:45.510863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:45.511311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:45.568903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:45.576669 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c0a710d7-6347-4362-a9df-dca0a59440a7 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078363 Mar 08 20:00:45.577233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 527/1075] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:45 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:46.593819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:46.594427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:46.600682 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:46.601137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:46.601908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:46.602349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:46.660773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:46.667969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4a08da42-50c9-46f0-a828-7d63aa04d15e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078032 Mar 08 20:00:46.668563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 549/1076] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:46 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:47.684516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:47.685128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:47.691282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:47.691730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:47.692530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:47.692972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:47.750337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:47.757506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fa97a1e5-6110-41ed-a649-39fa7b0e44ee tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.076949 Mar 08 20:00:47.758064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 528/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:47 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:48.774695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:48.775240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:48.781766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:48.782214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:48.782978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:48.783412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:48.842119 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:48.849325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c375050d-96d8-49ce-a154-61392de9270e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079147 Mar 08 20:00:48.849879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 550/1078] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:48 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:49.865824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:49.866471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:49.872736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:49.873185 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:49.873952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:49.874387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:49.936768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:49.943932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-14aa35c5-5f40-4a46-91ee-adc94cb3ef63 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082053 Mar 08 20:00:49.944522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 529/1079] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:49 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:50.960364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:50.960970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:50.967131 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:50.967586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:50.968418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:50.968857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:51.030386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:51.037663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9f826515-aa55-42f0-af06-fe9be6ddf2fb tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081142 Mar 08 20:00:51.038219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 551/1080] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:50 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:51.865574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:51.866082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:51.872253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:51.872737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:51.873506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:51.873944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:51.887650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] HTTP exception thrown: Instance 29933d05-3536-4ba1-8676-36a83a073710 could not be found. Mar 08 20:00:51.888258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Returning 404 to user: Instance 29933d05-3536-4ba1-8676-36a83a073710 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:00:51.889099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1bbd2e83-abc9-44f5-8b4c-20a212391ed7 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 404 len: 111 microversion: 2.20 time: 0.027467 Mar 08 20:00:51.889791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 530/1081] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Mar 8 20:00:51 2022] DELETE /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:00:51.898188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:51.898993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 29933d05-3536-4ba1-8676-36a83a073710] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:51.906034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:51.906558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:51.907424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:51.907912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:51.921185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] HTTP exception thrown: Instance 29933d05-3536-4ba1-8676-36a83a073710 could not be found. Mar 08 20:00:51.921850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Returning 404 to user: Instance 29933d05-3536-4ba1-8676-36a83a073710 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:00:51.922740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6aa5ec35-ea4e-49c6-a8a2-388839a033d2 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710" status: 404 len: 111 microversion: 2.20 time: 0.029105 Mar 08 20:00:51.923274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 552/1082] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 20:00:51 2022] GET /compute/v2.1/servers/29933d05-3536-4ba1-8676-36a83a073710 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 08 20:00:51.977436 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:51.977928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:51.983645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:51.984087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:51.984881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:51.985315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:52.008625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:00:52.054498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:52.055141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:52.061516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:52.061970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:52.062745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:52.063185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:52.065703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [b4e3a161-3bde-4a64-8d22-036125e89b59] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 20:00:52.121952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:52.129385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-02740cdb-951a-42df-b152-2c0e18729ac3 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078723 Mar 08 20:00:52.129942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 553/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:52 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:00:53.073051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [b4e3a161-3bde-4a64-8d22-036125e89b59] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50314. Mar 08 20:00:53.092718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f74f515e-36fb-42b9-8bb7-94267aefc593 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 204 len: 0 microversion: 2.1 time: 1.119042 Mar 08 20:00:53.093454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 531/1084] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:00:51 2022] DELETE /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:00:53.101419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:53.102566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:53.108912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:53.109370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:53.110155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:53.110595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:53.146431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:53.147120 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:53.153560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:53.154009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:53.154765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:53.155470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:53.216595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:53.223976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5bc8bc3d-67ea-41d9-938e-83ed38ea59b0 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081717 Mar 08 20:00:53.224773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 532/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:53 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:00:53.244208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:53.251470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7df290c9-c8b3-4500-8ac1-732ee9bc6912 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1682 microversion: 2.1 time: 0.153886 Mar 08 20:00:53.252011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 554/1086] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:53 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:54.240531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:54.241159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:54.248374 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:54.248824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:54.249594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:54.250028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:54.270599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:54.271814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:54.279574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:54.280544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:54.281377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:54.281881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:54.315952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:54.323629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4da81f2f-4f07-42d4-839b-ab898c99af20 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.086946 Mar 08 20:00:54.324558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 533/1087] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:54 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:54.343008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b654ac865d634424843f844edc8a12ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f11a138e0849f79d37eff5a59cf1cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:54.350349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1b30e9d7-2344-42c5-a769-fd0b13a493b2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 200 len: 1614 microversion: 2.1 time: 0.083846 Mar 08 20:00:54.350918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 555/1088] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:54 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:54.572373 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-e540ab25-3d3f-4601-92c9-986219f193fc req-397703e2-40d0-416c-9243-c9849c329308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b992e6-93af-4c5c-8e4f-8004842e455e", "name": "network-vif-deleted", "tag": "4f48c927-0691-47e3-8433-ee3ab38d9048"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:00:54.582968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e540ab25-3d3f-4601-92c9-986219f193fc req-397703e2-40d0-416c-9243-c9849c329308 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:54.583501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e540ab25-3d3f-4601-92c9-986219f193fc req-397703e2-40d0-416c-9243-c9849c329308 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:54.597988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-e540ab25-3d3f-4601-92c9-986219f193fc req-397703e2-40d0-416c-9243-c9849c329308 service nova] Creating event network-vif-deleted:4f48c927-0691-47e3-8433-ee3ab38d9048 for instance 30b992e6-93af-4c5c-8e4f-8004842e455e on hv-cinder-83009 Mar 08 20:00:54.603702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-e540ab25-3d3f-4601-92c9-986219f193fc req-397703e2-40d0-416c-9243-c9849c329308 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116963 Mar 08 20:00:54.604331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 534/1089] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:00:55.340465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:55.341078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:55.347387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:55.347841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:55.348637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:55.349094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:55.373232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:55.374240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:55.380770 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:55.381411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:55.382454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:55.383136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:55.401448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance 30b992e6-93af-4c5c-8e4f-8004842e455e could not be found. Mar 08 20:00:55.402225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance 30b992e6-93af-4c5c-8e4f-8004842e455e could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:00:55.403164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a6fb2ca1-094e-42c1-a334-14ca60c437c2 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 404 len: 111 microversion: 2.1 time: 0.035520 Mar 08 20:00:55.405312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 535/1090] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:55 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 20:00:55.412886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9595bf40-1074-4be3-a65b-9e5926e4d01c tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '.version_select at 0x7f0704d31670>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:55.419428 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:55.427668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2d85eb3d-062e-4899-8d82-74e37fb33e19 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.091091 Mar 08 20:00:55.428607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 556/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:55 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:55.439768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9595bf40-1074-4be3-a65b-9e5926e4d01c tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008730207" status: 202 len: 0 microversion: 2.1 time: 0.031003 Mar 08 20:00:55.440367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 536/1092] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Mar 8 20:00:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008730207 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 20:00:56.444433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:56.444963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:56.451773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:56.452219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:56.453013 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:56.453450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:56.511397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:56.518539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6399b772-050a-4e36-be91-ab5133e0d7b2 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078092 Mar 08 20:00:56.519092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 557/1093] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:56 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:57.535846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:57.536428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:57.542959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:57.543415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:57.544183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:57.544654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:57.604893 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:57.612124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-efc810a2-2bf1-4de1-a5c1-65fb102bde23 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.080791 Mar 08 20:00:57.612712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 537/1094] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:57 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:58.629399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:58.630011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:58.637176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:58.637630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:58.638395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:58.638835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:58.696202 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:58.704091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-608da2f3-9341-4603-ba3f-2fb34dd8246e tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078598 Mar 08 20:00:58.704676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 558/1095] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:58 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:00:59.720544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:00:59.721158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:00:59.727406 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:59.727801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:59.728601 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:00:59.729046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:00:59.791971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:00:59.799173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-02617b3d-f4bb-47d4-b8b9-aa216962fa12 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.082551 Mar 08 20:00:59.799717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 538/1096] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:00:59 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:00.815986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:00.816558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:00.822780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:00.823235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:00.824001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:00.824552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:00.882439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:00.889801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6651608a-0459-490f-a1b3-c076b894ee4b tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077838 Mar 08 20:01:00.890345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 559/1097] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:00 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:01.957149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:01.957750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:01.964691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:01.965141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:01.965899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:01.966331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:02.023152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:02.031178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3fc82644-0a5c-4550-8388-e581f2797ba9 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077921 Mar 08 20:01:02.031730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 539/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:01 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:03.048158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:03.048784 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:03.055109 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:03.055562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:03.056353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:03.057355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:03.118256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:03.126177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c7d86d3c-425a-48d8-9b64-ad329320ebc8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.081951 Mar 08 20:01:03.126738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 560/1099] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:03 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:04.143356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:04.143991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:04.150177 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:04.151273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:04.152035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:04.152571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:04.210952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:04.219043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-33147d0b-cf02-43d2-974c-44eaa0c153d1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079500 Mar 08 20:01:04.219830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 540/1100] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:04 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:05.235862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:05.236511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:05.242738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:05.243191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:05.243962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:05.245006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:05.303986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:05.311610 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0c8e476e-b9b9-4ff8-a474-9cf7720ce2f8 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079622 Mar 08 20:01:05.312163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 561/1101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:05 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:06.327767 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:06.328420 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:06.334654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:06.335102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:06.335864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:06.336311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:06.394669 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:06.402519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e690ac8a-45bf-4b72-8962-71f2749efbef tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078561 Mar 08 20:01:06.403081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 541/1102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:06 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:07.418816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:07.419423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:07.425641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:07.426088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:07.426849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:07.427311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:07.485550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:07.492821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-16814bb7-60ac-4dd4-89a4-32828f1b237a tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.077868 Mar 08 20:01:07.493375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 562/1103] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:07 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:08.510427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:08.510960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:08.517086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:08.517539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:08.518304 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:08.518773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:08.576838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:08.584089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e3a7f65e-ebd0-4e06-bba9-4d4d2eb679b1 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078191 Mar 08 20:01:08.584676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 542/1104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:08 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:09.601265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:09.601872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:09.608728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:09.609179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:09.609936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:09.610364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:09.669916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:09.677210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-74026fea-b4a7-4c79-a551-686443095fe5 tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.079777 Mar 08 20:01:09.677767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 563/1105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:09 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:10.693349 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:10.693961 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] [instance: 08ec178e-8ba4-4606-8aa8-131038fc027e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:10.700843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:10.701292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:10.702060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:10.702505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:10.760647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0a8deca7d04add938354e5a1c1c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b47b5204f2f43e5a2162e5e0f450500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:01:10.767831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-27dc2ba8-9439-4c7a-a9f1-0627163678ae tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e" status: 200 len: 1219 microversion: 2.1 time: 0.078333 Mar 08 20:01:10.768421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 543/1106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:01:10 2022] GET /compute/v2.1/servers/08ec178e-8ba4-4606-8aa8-131038fc027e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:01:10.932426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e988a64d-4e68-462c-9fdc-6321c3df306d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] Calling method '.version_select at 0x7f070488daf0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:10.953998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e988a64d-4e68-462c-9fdc-6321c3df306d tempest-TestShelveInstance-471806902 tempest-TestShelveInstance-471806902-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1334473538" status: 202 len: 0 microversion: 2.1 time: 0.026458 Mar 08 20:01:10.954580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 564/1107] 10.222.0.45 () {58 vars in 1253 bytes} [Tue Mar 8 20:01:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1334473538 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:01:12.241508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:01:12.242173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:01:12.249668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:12.250279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:01:12.251081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:01:12.251524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:02:12.297046 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:02:12.297627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:02:12.303454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:02:12.303908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:02:12.304711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:02:12.305155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:02:13.052414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:02:13.052990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 (ip 10.222.0.45) !!! Mar 08 20:02:38.952484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:02:38.953011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:02:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 (ip 10.222.0.45) !!! Mar 08 20:02:52.328947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lazy-loading 'services' on Instance uuid fb579508-9118-47e4-a758-8e9c83890f77 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:02:52.841945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lazy-loading 'services' on Instance uuid fb579508-9118-47e4-a758-8e9c83890f77 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:03:12.458283 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9f227421-21f9-464b-9a9d-54795beed7f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4" status: 202 len: 0 microversion: 2.1 time: 120.222634 Mar 08 20:03:12.459074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 544/1108] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 20:01:12 2022] DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 => generated 0 bytes in 120224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:03:12.466031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:03:12.466625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:03:12.473542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:03:12.473994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:03:12.475219 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:03:12.475735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:03:12.482481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-736d46a8-e366-4d4d-bb48-c8a26e5b6cac) Mar 08 20:03:12.483813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-736d46a8-e366-4d4d-bb48-c8a26e5b6cac) {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:03:12.485394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d5ed945a-a1ae-466b-b8f7-99ab2251b039 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4" status: 400 len: 269 microversion: 2.1 time: 60.193383 Mar 08 20:03:12.486295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 565/1109] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 20:02:12 2022] DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 => generated 269 bytes in 60195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:04:03.441625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:04:03.442282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:04:10.761865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:04:10.762379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 (ip 10.222.0.45) !!! Mar 08 20:04:12.415815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:04:12.416346 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:04:12.422920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:04:12.423369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:04:12.424129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:04:12.424603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:04:24.527137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:04:24.528195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:04:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 (ip 10.222.0.45) !!! Mar 08 20:04:53.017230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lazy-loading 'services' on Instance uuid fb579508-9118-47e4-a758-8e9c83890f77 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:04:53.332043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lazy-loading 'services' on Instance uuid fb579508-9118-47e4-a758-8e9c83890f77 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:05:12.688740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5c3eeb-8965-4b2f-a91d-1a85af83a827) Mar 08 20:05:12.689367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5c3eeb-8965-4b2f-a91d-1a85af83a827) {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:05:12.690886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-16eecbc9-8f9c-47e6-bbc0-50f566127eb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4" status: 400 len: 269 microversion: 2.1 time: 120.229835 Mar 08 20:05:12.691668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 545/1110] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 20:03:12 2022] DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 => generated 269 bytes in 120232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:05:12.697258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:12.697827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:12.703502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.703959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:12.704766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.705207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:12.722248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f8b4889-11cc-4c4e-af41-450d8d023a9a) Mar 08 20:05:12.723525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f8b4889-11cc-4c4e-af41-450d8d023a9a) {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:05:12.724454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-557bd376-8ee4-4abe-abd6-d154abd206b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4" status: 400 len: 269 microversion: 2.1 time: 60.314130 Mar 08 20:05:12.725475 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 566/1111] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 20:04:12 2022] DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 => generated 269 bytes in 60316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 20:05:12.730238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:05:12.731266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:12.731846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:12.737650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.738168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:12.739069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.739578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:12.812330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9f431e00-1f52-4732-8b42-e92ea14ee7cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 204 len: 0 microversion: 2.1 time: 0.119569 Mar 08 20:05:12.812927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 546/1112] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:05:12 2022] DELETE /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:05:12.822217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:12.823040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:12.828649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.829102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:12.829881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.830321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:12.916323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lazy-loading 'services' on Instance uuid fb579508-9118-47e4-a758-8e9c83890f77 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:05:12.975154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02c0b6b4-a79f-465e-9dd2-da28cecea138) Mar 08 20:05:12.975758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02c0b6b4-a79f-465e-9dd2-da28cecea138) {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:05:12.975900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:12.976637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f1d5184f-0375-440a-8ac6-0e6a447641fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4" status: 400 len: 269 microversion: 2.1 time: 0.250237 Mar 08 20:05:12.977185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 567/1113] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 20:05:12 2022] DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments/bd956386-4a6e-4ac5-9004-cc8e276a1bf4 => generated 269 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:05:12.984198 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7d5c0716-c940-4f15-bb4c-89eea53f1367 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.166462 Mar 08 20:05:12.984873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 547/1114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:12 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:05:12.986353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1c6fe492-45d1-4bc5-be3b-551da75f6861 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:12.987316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1c6fe492-45d1-4bc5-be3b-551da75f6861 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:12.994255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c6fe492-45d1-4bc5-be3b-551da75f6861 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.994675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c6fe492-45d1-4bc5-be3b-551da75f6861 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:12.995442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c6fe492-45d1-4bc5-be3b-551da75f6861 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:12.995868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c6fe492-45d1-4bc5-be3b-551da75f6861 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:13.029956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1c6fe492-45d1-4bc5-be3b-551da75f6861 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047518 Mar 08 20:05:13.030514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 568/1115] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:14.002572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:14.003198 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:14.009928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:14.010372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:14.011156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:14.011585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:14.041672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bc241680-8ca0-46f7-b0bb-283a379d9ec7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:14.042499 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bc241680-8ca0-46f7-b0bb-283a379d9ec7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:14.049217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc241680-8ca0-46f7-b0bb-283a379d9ec7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:14.049677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc241680-8ca0-46f7-b0bb-283a379d9ec7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:14.050455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc241680-8ca0-46f7-b0bb-283a379d9ec7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:14.050893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc241680-8ca0-46f7-b0bb-283a379d9ec7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:14.079994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bc241680-8ca0-46f7-b0bb-283a379d9ec7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Mar 08 20:05:14.080948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 569/1116] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:14.144623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:14.153431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-956f1b7e-c32b-42b3-b417-982c63a45f02 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154747 Mar 08 20:05:14.153993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 548/1117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:13 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:15.091856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9c88d6ac-868a-4932-af70-3dd18074adfd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:15.092800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9c88d6ac-868a-4932-af70-3dd18074adfd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:15.099049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c88d6ac-868a-4932-af70-3dd18074adfd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:15.099501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c88d6ac-868a-4932-af70-3dd18074adfd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:15.100261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c88d6ac-868a-4932-af70-3dd18074adfd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:15.100730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c88d6ac-868a-4932-af70-3dd18074adfd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:15.128980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9c88d6ac-868a-4932-af70-3dd18074adfd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Mar 08 20:05:15.129526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 570/1118] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:15.170320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:15.170933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:15.177239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:15.177692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:15.178463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:15.178904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:15.310685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:15.318412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8cfe472c-6d76-4251-bb8e-696f86925c4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151994 Mar 08 20:05:15.318970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 549/1119] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:15 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:16.140696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cbb78b80-f4ba-4e25-bbfa-3df3e276c13f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:16.141627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cbb78b80-f4ba-4e25-bbfa-3df3e276c13f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:16.147891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cbb78b80-f4ba-4e25-bbfa-3df3e276c13f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:16.148373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cbb78b80-f4ba-4e25-bbfa-3df3e276c13f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:16.149196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cbb78b80-f4ba-4e25-bbfa-3df3e276c13f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:16.149636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cbb78b80-f4ba-4e25-bbfa-3df3e276c13f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:16.177914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cbb78b80-f4ba-4e25-bbfa-3df3e276c13f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041500 Mar 08 20:05:16.178454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 571/1120] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:16.335373 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:16.335976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:16.342282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:16.342733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:16.343498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:16.343940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:16.471504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:16.479754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6ac24380-f062-4704-8cda-e1bbab264856 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148239 Mar 08 20:05:16.480338 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 550/1121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:16 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:17.189923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c047595c-02e4-41bf-af60-9cecae5dc6c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:17.190761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c047595c-02e4-41bf-af60-9cecae5dc6c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:17.196973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c047595c-02e4-41bf-af60-9cecae5dc6c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:17.197426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c047595c-02e4-41bf-af60-9cecae5dc6c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:17.198172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c047595c-02e4-41bf-af60-9cecae5dc6c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:17.198602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c047595c-02e4-41bf-af60-9cecae5dc6c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:17.225798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c047595c-02e4-41bf-af60-9cecae5dc6c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039879 Mar 08 20:05:17.226416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 572/1122] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:17.497261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:17.497800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:17.503998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:17.504477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:17.505245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:17.505710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:17.637568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:17.645268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-92b8a923-2041-4124-b8f0-e6a7507ca0af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152043 Mar 08 20:05:17.645822 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 551/1123] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:17 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:18.238013 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f92fef05-f1b3-4087-a455-7ad839bc1fc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:18.238863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f92fef05-f1b3-4087-a455-7ad839bc1fc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:18.245153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92fef05-f1b3-4087-a455-7ad839bc1fc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:18.245606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92fef05-f1b3-4087-a455-7ad839bc1fc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:18.246376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92fef05-f1b3-4087-a455-7ad839bc1fc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:18.246812 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92fef05-f1b3-4087-a455-7ad839bc1fc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:18.275173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f92fef05-f1b3-4087-a455-7ad839bc1fc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 Mar 08 20:05:18.275717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 573/1124] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:18.662328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:18.662941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:18.669262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:18.669711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:18.670484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:18.670920 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:18.800127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:18.807965 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-673d9911-a4b4-418a-b64f-d4b43d0485f5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149472 Mar 08 20:05:18.808568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 552/1125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:18 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:19.287844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-21e09d11-0d9f-4ce1-96e3-e2f287dacdb1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:19.288703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-21e09d11-0d9f-4ce1-96e3-e2f287dacdb1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:19.295442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21e09d11-0d9f-4ce1-96e3-e2f287dacdb1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:19.295895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21e09d11-0d9f-4ce1-96e3-e2f287dacdb1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:19.296687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21e09d11-0d9f-4ce1-96e3-e2f287dacdb1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:19.297129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21e09d11-0d9f-4ce1-96e3-e2f287dacdb1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:19.324929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-21e09d11-0d9f-4ce1-96e3-e2f287dacdb1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041185 Mar 08 20:05:19.325477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 574/1126] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:19.825836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:19.826426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:19.832572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:19.833000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:19.833788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:19.834213 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:19.966990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:19.974780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-300dc822-eb14-4d57-8d27-fac69b6e9909 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152772 Mar 08 20:05:19.975337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 553/1127] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:19 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:05:20.337137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e548ccea-3d9f-4f65-8c69-90f0928092c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:20.338003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e548ccea-3d9f-4f65-8c69-90f0928092c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:20.343921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e548ccea-3d9f-4f65-8c69-90f0928092c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:20.344407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e548ccea-3d9f-4f65-8c69-90f0928092c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:20.345178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e548ccea-3d9f-4f65-8c69-90f0928092c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:20.345615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e548ccea-3d9f-4f65-8c69-90f0928092c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:20.374024 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e548ccea-3d9f-4f65-8c69-90f0928092c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Mar 08 20:05:20.374728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 575/1128] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:20.992579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:20.993147 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:20.999373 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:20.999819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:21.000614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:21.001051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:21.136076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:21.143801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d27d4608-5083-49a4-971c-b9a4b4563c47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155172 Mar 08 20:05:21.144386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 554/1129] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:20 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:21.386444 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7f6e1e52-d1b2-48fd-925b-76108f0c0348 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:21.387358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7f6e1e52-d1b2-48fd-925b-76108f0c0348 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:21.393571 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f6e1e52-d1b2-48fd-925b-76108f0c0348 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:21.394013 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f6e1e52-d1b2-48fd-925b-76108f0c0348 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:21.394776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f6e1e52-d1b2-48fd-925b-76108f0c0348 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:21.395210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f6e1e52-d1b2-48fd-925b-76108f0c0348 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:21.422740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7f6e1e52-d1b2-48fd-925b-76108f0c0348 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040907 Mar 08 20:05:21.423375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 576/1130] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:22.160807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:22.161405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:22.167582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:22.168029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:22.168812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:22.169239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:22.300272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:22.308576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a70b7e7e-2fad-44b8-853c-23aa0a0f4c10 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151676 Mar 08 20:05:22.309132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 555/1131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:22 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:22.434280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4786770e-aebe-47e6-85c6-d54f89ab48f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:22.435160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4786770e-aebe-47e6-85c6-d54f89ab48f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:22.441348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4786770e-aebe-47e6-85c6-d54f89ab48f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:22.441802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4786770e-aebe-47e6-85c6-d54f89ab48f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:22.442572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4786770e-aebe-47e6-85c6-d54f89ab48f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:22.443016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4786770e-aebe-47e6-85c6-d54f89ab48f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:22.470415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4786770e-aebe-47e6-85c6-d54f89ab48f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040716 Mar 08 20:05:22.470962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 577/1132] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:23.325125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:23.325735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:23.331942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:23.332429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:23.333210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:23.333643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:23.466522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:23.475453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2e2818f6-0f32-4400-8a2f-52ac63983f00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154136 Mar 08 20:05:23.477005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 556/1133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:23 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:23.484045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1948c208-2ff7-4c0f-a9c5-a1432cde7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:23.484991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1948c208-2ff7-4c0f-a9c5-a1432cde7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:23.491376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1948c208-2ff7-4c0f-a9c5-a1432cde7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:23.491833 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1948c208-2ff7-4c0f-a9c5-a1432cde7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:23.492721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1948c208-2ff7-4c0f-a9c5-a1432cde7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:23.493162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1948c208-2ff7-4c0f-a9c5-a1432cde7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:23.520566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1948c208-2ff7-4c0f-a9c5-a1432cde7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040380 Mar 08 20:05:23.521107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 578/1134] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:24.494958 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:24.495503 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:24.501816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:24.502264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:24.503028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:24.503461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:24.533906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e3d096dc-8247-47d9-9954-b4cd3a09a08a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:24.534826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e3d096dc-8247-47d9-9954-b4cd3a09a08a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:24.541998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d096dc-8247-47d9-9954-b4cd3a09a08a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:24.542452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d096dc-8247-47d9-9954-b4cd3a09a08a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:24.543227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d096dc-8247-47d9-9954-b4cd3a09a08a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:24.543666 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d096dc-8247-47d9-9954-b4cd3a09a08a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:24.575147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e3d096dc-8247-47d9-9954-b4cd3a09a08a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Mar 08 20:05:24.575712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 579/1135] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:24.632958 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:24.640619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-252a5783-7990-406a-800a-e1e750ba0612 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150288 Mar 08 20:05:24.641184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 557/1136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:24 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:25.587090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9263b65d-9260-49e2-9cd0-940ab2becdf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:25.588011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9263b65d-9260-49e2-9cd0-940ab2becdf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:25.594406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9263b65d-9260-49e2-9cd0-940ab2becdf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:25.594856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9263b65d-9260-49e2-9cd0-940ab2becdf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:25.595625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9263b65d-9260-49e2-9cd0-940ab2becdf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:25.596061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9263b65d-9260-49e2-9cd0-940ab2becdf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:25.624603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9263b65d-9260-49e2-9cd0-940ab2becdf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 Mar 08 20:05:25.625150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 580/1137] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:25.657648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:25.658261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:25.665089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:25.665535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:25.666289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:25.666720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:25.797445 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:25.805159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-252deade-3352-4319-bc48-430a2b720bc8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151343 Mar 08 20:05:25.805716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 558/1138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:25 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:26.635794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-35a01ffe-9fc8-4ea8-9790-87d8173349c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:26.636650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-35a01ffe-9fc8-4ea8-9790-87d8173349c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:26.642940 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35a01ffe-9fc8-4ea8-9790-87d8173349c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:26.643399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35a01ffe-9fc8-4ea8-9790-87d8173349c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:26.644184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35a01ffe-9fc8-4ea8-9790-87d8173349c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:26.644655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-35a01ffe-9fc8-4ea8-9790-87d8173349c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:26.672555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-35a01ffe-9fc8-4ea8-9790-87d8173349c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 Mar 08 20:05:26.673098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 581/1139] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:26.822093 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:26.822718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:26.829092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:26.829542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:26.830308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:26.830757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:26.961420 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:26.969021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cf306206-0360-4436-88ae-2fa91fdfc1e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150863 Mar 08 20:05:26.969581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 559/1140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:26 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:27.683826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2ce8724c-6ee6-406f-a4a1-25db7523930d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:27.684683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2ce8724c-6ee6-406f-a4a1-25db7523930d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:27.690898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce8724c-6ee6-406f-a4a1-25db7523930d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:27.691349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce8724c-6ee6-406f-a4a1-25db7523930d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:27.692114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce8724c-6ee6-406f-a4a1-25db7523930d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:27.692575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce8724c-6ee6-406f-a4a1-25db7523930d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:27.721342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2ce8724c-6ee6-406f-a4a1-25db7523930d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041542 Mar 08 20:05:27.721883 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 582/1141] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:27.986359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:27.986897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:27.993663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:27.994112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:27.994881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:27.995317 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:28.124897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:28.133236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ce200c1d-3eee-44c2-ad8e-2cc9efbd391c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150186 Mar 08 20:05:28.133792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 560/1142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:27 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:28.732862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-759055df-1c5d-4797-8903-3ee2db928873 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:28.733707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-759055df-1c5d-4797-8903-3ee2db928873 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:28.740233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-759055df-1c5d-4797-8903-3ee2db928873 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:28.740718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-759055df-1c5d-4797-8903-3ee2db928873 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:28.741485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-759055df-1c5d-4797-8903-3ee2db928873 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:28.742500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-759055df-1c5d-4797-8903-3ee2db928873 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:28.772144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-759055df-1c5d-4797-8903-3ee2db928873 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 Mar 08 20:05:28.772727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 583/1143] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:29.150096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:29.150707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:29.157200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:29.157654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:29.158432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:29.158873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:29.395935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:29.404599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1672389b-18b7-4f76-bbd4-2de7069fc6aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.258393 Mar 08 20:05:29.405166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 561/1144] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:29 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:29.784393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-717e86fd-e84d-4c4a-aa63-e6dc62b0bda6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:29.785311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-717e86fd-e84d-4c4a-aa63-e6dc62b0bda6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:29.791683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-717e86fd-e84d-4c4a-aa63-e6dc62b0bda6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:29.792132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-717e86fd-e84d-4c4a-aa63-e6dc62b0bda6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:29.792945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-717e86fd-e84d-4c4a-aa63-e6dc62b0bda6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:29.793382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-717e86fd-e84d-4c4a-aa63-e6dc62b0bda6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:29.825584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-717e86fd-e84d-4c4a-aa63-e6dc62b0bda6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046125 Mar 08 20:05:29.826430 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 584/1145] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:30.422735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:30.423265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:30.430404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:30.430854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:30.431613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:30.432046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:30.562555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:30.570898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e0f81b34-77b0-4636-bc4d-623ac69626ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152172 Mar 08 20:05:30.571460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 562/1146] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:30 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:30.837399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1ccefa52-2dd9-450f-8cc2-c03dad934a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:30.838304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1ccefa52-2dd9-450f-8cc2-c03dad934a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:30.844506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ccefa52-2dd9-450f-8cc2-c03dad934a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:30.844954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ccefa52-2dd9-450f-8cc2-c03dad934a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:30.845714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ccefa52-2dd9-450f-8cc2-c03dad934a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:30.846145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1ccefa52-2dd9-450f-8cc2-c03dad934a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:30.873616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1ccefa52-2dd9-450f-8cc2-c03dad934a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040660 Mar 08 20:05:30.874143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 585/1147] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:31.587824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:31.588539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:31.594947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:31.595401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:31.596181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:31.596759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:31.729268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:31.736981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-82a1d825-70b2-483a-8af7-6d8ce8f3acc0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153600 Mar 08 20:05:31.737548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 563/1148] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:31 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:31.884994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-eab20273-aa11-42d9-83ab-1364cf98814d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:31.885922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-eab20273-aa11-42d9-83ab-1364cf98814d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:31.892084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eab20273-aa11-42d9-83ab-1364cf98814d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:31.892599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eab20273-aa11-42d9-83ab-1364cf98814d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:31.893366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eab20273-aa11-42d9-83ab-1364cf98814d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:31.893807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eab20273-aa11-42d9-83ab-1364cf98814d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:31.922537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-eab20273-aa11-42d9-83ab-1364cf98814d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041505 Mar 08 20:05:31.923074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 586/1149] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:32.753774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:32.754406 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:32.761073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:32.761530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:32.762302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:32.762742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:32.893033 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:32.900677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4021f979-9cd4-437c-b1f9-1a1c3d546565 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150668 Mar 08 20:05:32.901245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 564/1150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:32 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:32.934350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b11d1492-d741-4862-a445-49c144037854 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:32.935800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b11d1492-d741-4862-a445-49c144037854 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:32.941962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b11d1492-d741-4862-a445-49c144037854 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:32.942415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b11d1492-d741-4862-a445-49c144037854 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:32.943185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b11d1492-d741-4862-a445-49c144037854 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:32.943622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b11d1492-d741-4862-a445-49c144037854 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:32.970761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b11d1492-d741-4862-a445-49c144037854 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040364 Mar 08 20:05:32.971300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 587/1151] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:33.061591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:05:33.061776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:05:33.917627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:33.918199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:33.927088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:33.927531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:33.928313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:33.928754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:33.983396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-65ab2718-ea3e-40b8-a954-17fe446ec538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:33.984349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-65ab2718-ea3e-40b8-a954-17fe446ec538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:33.990601 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65ab2718-ea3e-40b8-a954-17fe446ec538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:33.991051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65ab2718-ea3e-40b8-a954-17fe446ec538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:33.992570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65ab2718-ea3e-40b8-a954-17fe446ec538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:33.993299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65ab2718-ea3e-40b8-a954-17fe446ec538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:34.022719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-65ab2718-ea3e-40b8-a954-17fe446ec538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Mar 08 20:05:34.028436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 588/1152] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:34.089883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:34.097712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2fb299a-4137-487e-a0bf-4b05d82ebceb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.184011 Mar 08 20:05:34.098372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 565/1153] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:33 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:35.034381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ca7e0ca4-b378-44a5-8164-60e10f62d39c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:35.035226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ca7e0ca4-b378-44a5-8164-60e10f62d39c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:35.042070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7e0ca4-b378-44a5-8164-60e10f62d39c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:35.042529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7e0ca4-b378-44a5-8164-60e10f62d39c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:35.043302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7e0ca4-b378-44a5-8164-60e10f62d39c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:35.043743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca7e0ca4-b378-44a5-8164-60e10f62d39c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:35.071923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ca7e0ca4-b378-44a5-8164-60e10f62d39c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041676 Mar 08 20:05:35.072491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 589/1154] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:35.114845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:35.115528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:35.122398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:35.122843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:35.123608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:35.124042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:35.252425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:35.260311 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-71fbb36c-6c67-4d27-b257-1596e36c3618 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149288 Mar 08 20:05:35.260896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 566/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:35 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:36.083052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d3192fe0-ecc4-4ab2-bbfd-d975b18e4728 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:36.083960 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d3192fe0-ecc4-4ab2-bbfd-d975b18e4728 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:36.090638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3192fe0-ecc4-4ab2-bbfd-d975b18e4728 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:36.091083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3192fe0-ecc4-4ab2-bbfd-d975b18e4728 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:36.091835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3192fe0-ecc4-4ab2-bbfd-d975b18e4728 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:36.092265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3192fe0-ecc4-4ab2-bbfd-d975b18e4728 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:36.120846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d3192fe0-ecc4-4ab2-bbfd-d975b18e4728 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041599 Mar 08 20:05:36.121404 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 590/1156] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:36.276996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:36.277608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:36.283799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:36.284248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:36.285044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:36.285481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:36.420207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:36.427921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f3f2bab5-7468-4105-8307-b9afa6010823 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155535 Mar 08 20:05:36.428503 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 567/1157] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:36 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:37.132945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ce5e01df-9e72-4d31-8240-0454c29b8548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:37.133868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ce5e01df-9e72-4d31-8240-0454c29b8548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:37.140102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ce5e01df-9e72-4d31-8240-0454c29b8548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:37.140587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ce5e01df-9e72-4d31-8240-0454c29b8548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:37.141359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ce5e01df-9e72-4d31-8240-0454c29b8548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:37.141801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ce5e01df-9e72-4d31-8240-0454c29b8548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:37.169865 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ce5e01df-9e72-4d31-8240-0454c29b8548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Mar 08 20:05:37.170414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 591/1158] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:37.443808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:37.444436 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:37.450327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:37.450769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:37.451517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:37.451949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:37.582744 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:37.590944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7b08c626-abb8-4a02-bee5-8f4abba50853 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151026 Mar 08 20:05:37.591497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 568/1159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:37 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:38.181891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e3064c17-804a-4af0-8ce5-4cf0af8c39db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:38.182812 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e3064c17-804a-4af0-8ce5-4cf0af8c39db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:38.189051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3064c17-804a-4af0-8ce5-4cf0af8c39db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:38.189506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3064c17-804a-4af0-8ce5-4cf0af8c39db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:38.190274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3064c17-804a-4af0-8ce5-4cf0af8c39db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:38.190714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3064c17-804a-4af0-8ce5-4cf0af8c39db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:38.218026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e3064c17-804a-4af0-8ce5-4cf0af8c39db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Mar 08 20:05:38.218565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 592/1160] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:38.608372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:38.608985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:38.615237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:38.615688 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:38.617110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:38.617555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:38.746462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:38.754340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f1339502-9037-4e03-88b1-4c80643c144d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149914 Mar 08 20:05:38.754904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 569/1161] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:38 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:39.229358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-59175fa9-c0c6-4abf-9a7f-7e8ad27a6ce1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:39.230219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-59175fa9-c0c6-4abf-9a7f-7e8ad27a6ce1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:39.236541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59175fa9-c0c6-4abf-9a7f-7e8ad27a6ce1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:39.236990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59175fa9-c0c6-4abf-9a7f-7e8ad27a6ce1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:39.237774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59175fa9-c0c6-4abf-9a7f-7e8ad27a6ce1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:39.238204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-59175fa9-c0c6-4abf-9a7f-7e8ad27a6ce1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:39.266243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-59175fa9-c0c6-4abf-9a7f-7e8ad27a6ce1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040882 Mar 08 20:05:39.266770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 593/1162] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:39.771732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:39.772274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:39.778719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:39.779173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:39.779935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:39.780400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:39.911188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:39.919364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-95373db0-3483-41a7-9838-8dc25e540ffe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151634 Mar 08 20:05:39.919930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 570/1163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:39 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:40.278384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ac57d586-c1f4-4ed8-a692-533cc459bd2c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:40.279333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ac57d586-c1f4-4ed8-a692-533cc459bd2c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:40.285541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac57d586-c1f4-4ed8-a692-533cc459bd2c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:40.285984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac57d586-c1f4-4ed8-a692-533cc459bd2c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:40.286752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac57d586-c1f4-4ed8-a692-533cc459bd2c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:40.287182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac57d586-c1f4-4ed8-a692-533cc459bd2c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:40.314395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ac57d586-c1f4-4ed8-a692-533cc459bd2c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040211 Mar 08 20:05:40.314913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 594/1164] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:40.936507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:40.937045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:40.943682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:40.944318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:40.945697 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:40.946124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:41.089795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:41.097505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d737e99c-e829-4bc8-a3cb-8c80bff1b571 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.165032 Mar 08 20:05:41.098074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 571/1165] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:40 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:41.326289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4e0305ab-7699-4e67-8b81-5c7413f654c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:41.327204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4e0305ab-7699-4e67-8b81-5c7413f654c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:41.334539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e0305ab-7699-4e67-8b81-5c7413f654c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:41.334994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e0305ab-7699-4e67-8b81-5c7413f654c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:41.336323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e0305ab-7699-4e67-8b81-5c7413f654c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:41.336763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e0305ab-7699-4e67-8b81-5c7413f654c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:41.368954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4e0305ab-7699-4e67-8b81-5c7413f654c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046649 Mar 08 20:05:41.369516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 595/1166] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:42.113947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:42.114639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:42.121117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:42.121639 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:42.122413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:42.122851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:42.257521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:42.265371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d6c373c7-60bb-45a7-a805-91d5885499ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155442 Mar 08 20:05:42.265938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 572/1167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:42 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:42.380397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-266ad7f9-3793-4457-9be1-2b5ddfde290f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:42.381329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-266ad7f9-3793-4457-9be1-2b5ddfde290f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:42.387729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-266ad7f9-3793-4457-9be1-2b5ddfde290f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:42.388179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-266ad7f9-3793-4457-9be1-2b5ddfde290f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:42.388972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-266ad7f9-3793-4457-9be1-2b5ddfde290f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:42.389409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-266ad7f9-3793-4457-9be1-2b5ddfde290f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:42.418065 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-266ad7f9-3793-4457-9be1-2b5ddfde290f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Mar 08 20:05:42.418602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 596/1168] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:43.282833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:43.283429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:43.290357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:43.290817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:43.291597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:43.292044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:43.419400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:43.427179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d07e9990-a025-454e-aa3e-11ff62a7a8a6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148190 Mar 08 20:05:43.427746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 573/1169] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:43 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:05:43.429975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3449e877-0063-46e8-b76a-dd510adbdf89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:43.430885 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3449e877-0063-46e8-b76a-dd510adbdf89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:43.437307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3449e877-0063-46e8-b76a-dd510adbdf89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:43.437760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3449e877-0063-46e8-b76a-dd510adbdf89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:43.438555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3449e877-0063-46e8-b76a-dd510adbdf89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:43.438991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3449e877-0063-46e8-b76a-dd510adbdf89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:43.467020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3449e877-0063-46e8-b76a-dd510adbdf89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Mar 08 20:05:43.467569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 597/1170] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:44.445093 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:44.445723 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:44.451948 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:44.452446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:44.453214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:44.453655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:44.478469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cafd7bc8-0f1d-41a6-91ec-3e502a6ecd30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:44.479420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cafd7bc8-0f1d-41a6-91ec-3e502a6ecd30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:44.485735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cafd7bc8-0f1d-41a6-91ec-3e502a6ecd30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:44.486190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cafd7bc8-0f1d-41a6-91ec-3e502a6ecd30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:44.486966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cafd7bc8-0f1d-41a6-91ec-3e502a6ecd30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:44.487406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cafd7bc8-0f1d-41a6-91ec-3e502a6ecd30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:44.517529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cafd7bc8-0f1d-41a6-91ec-3e502a6ecd30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042999 Mar 08 20:05:44.518085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 598/1171] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:44.582302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:44.590059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-74da5d8a-b17a-4b00-964a-bcae1e4c16fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149440 Mar 08 20:05:44.590561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 574/1172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:44 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:45.529226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a919bfff-1ae9-436c-ae05-c210861802db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:45.530178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a919bfff-1ae9-436c-ae05-c210861802db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:45.536406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a919bfff-1ae9-436c-ae05-c210861802db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:45.536867 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a919bfff-1ae9-436c-ae05-c210861802db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:45.537637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a919bfff-1ae9-436c-ae05-c210861802db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:45.538078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a919bfff-1ae9-436c-ae05-c210861802db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:45.566455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a919bfff-1ae9-436c-ae05-c210861802db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041425 Mar 08 20:05:45.566998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 599/1173] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:45.607338 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:45.607944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:45.614198 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:45.614641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:45.615402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:45.615835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:45.748253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:45.756089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-600feaaa-c98b-4d84-97f0-a63cc99aeb6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152665 Mar 08 20:05:45.756672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 575/1174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:45 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:46.578033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-de412e42-2665-43ef-97b0-4098ff8b30f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:46.578953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-de412e42-2665-43ef-97b0-4098ff8b30f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:46.585822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de412e42-2665-43ef-97b0-4098ff8b30f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:46.586395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de412e42-2665-43ef-97b0-4098ff8b30f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:46.587177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de412e42-2665-43ef-97b0-4098ff8b30f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:46.587621 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de412e42-2665-43ef-97b0-4098ff8b30f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:46.614967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-de412e42-2665-43ef-97b0-4098ff8b30f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040973 Mar 08 20:05:46.615511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 600/1175] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:46.773160 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:46.773732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:46.780252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:46.780738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:46.781510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:46.781947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:46.908553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:46.916330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0f1f21fa-5c99-415f-aca4-e9e6200e4dd3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147133 Mar 08 20:05:46.916981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 576/1176] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:46 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:47.627008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bdcc7a73-9805-42d7-9297-7f7a9493e76b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:47.627981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bdcc7a73-9805-42d7-9297-7f7a9493e76b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:47.634834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdcc7a73-9805-42d7-9297-7f7a9493e76b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:47.635282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdcc7a73-9805-42d7-9297-7f7a9493e76b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:47.636068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdcc7a73-9805-42d7-9297-7f7a9493e76b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:47.636529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdcc7a73-9805-42d7-9297-7f7a9493e76b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:47.663989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bdcc7a73-9805-42d7-9297-7f7a9493e76b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040979 Mar 08 20:05:47.664623 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 601/1177] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:47.933686 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:47.934295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:47.940472 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:47.940914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:47.941675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:47.942136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:48.072989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:48.080704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dc57b955-fced-4d8b-a95d-c7d937cfe79e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150779 Mar 08 20:05:48.081262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 577/1178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:47 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:48.675099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-40d39698-c2b0-4d82-b2bd-dbe0f77a7229 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:48.676018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-40d39698-c2b0-4d82-b2bd-dbe0f77a7229 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:48.682299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-40d39698-c2b0-4d82-b2bd-dbe0f77a7229 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:48.682752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-40d39698-c2b0-4d82-b2bd-dbe0f77a7229 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:48.683519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-40d39698-c2b0-4d82-b2bd-dbe0f77a7229 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:48.683961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-40d39698-c2b0-4d82-b2bd-dbe0f77a7229 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:48.712373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-40d39698-c2b0-4d82-b2bd-dbe0f77a7229 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041175 Mar 08 20:05:48.712917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 602/1179] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:49.100072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:49.100758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:49.107088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:49.107548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:49.108347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:49.108790 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:49.239794 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:49.247987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-312e2be5-d312-4b02-92da-30b6cb764dc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153675 Mar 08 20:05:49.248572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 578/1180] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:49 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:49.723636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2b56bd31-7d23-4f1b-8065-7f9ac5d720db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:49.724572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2b56bd31-7d23-4f1b-8065-7f9ac5d720db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:49.731271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b56bd31-7d23-4f1b-8065-7f9ac5d720db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:49.731719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b56bd31-7d23-4f1b-8065-7f9ac5d720db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:49.732512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b56bd31-7d23-4f1b-8065-7f9ac5d720db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:49.732950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b56bd31-7d23-4f1b-8065-7f9ac5d720db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:49.761160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2b56bd31-7d23-4f1b-8065-7f9ac5d720db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041527 Mar 08 20:05:49.761710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 603/1181] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:50.264735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:50.265334 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:50.271703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:50.272145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:50.273600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:50.274027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:50.403224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:50.411827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-54ec2945-ef92-4c20-b8be-5c728f733aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150905 Mar 08 20:05:50.412408 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 579/1182] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:50 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:05:50.772602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5beb8c7d-ec10-46b5-bd99-c972a1d20e18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:50.773511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5beb8c7d-ec10-46b5-bd99-c972a1d20e18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:50.779666 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5beb8c7d-ec10-46b5-bd99-c972a1d20e18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:50.780116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5beb8c7d-ec10-46b5-bd99-c972a1d20e18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:50.780899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5beb8c7d-ec10-46b5-bd99-c972a1d20e18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:50.781333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5beb8c7d-ec10-46b5-bd99-c972a1d20e18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:50.810670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5beb8c7d-ec10-46b5-bd99-c972a1d20e18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042020 Mar 08 20:05:50.811232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 604/1183] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:51.428979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:51.429524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:51.435627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:51.436065 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:51.436871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:51.437297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:51.571396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:51.579224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-39ddcef3-14ac-4d39-ad67-d07d30c4ac58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154170 Mar 08 20:05:51.579788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 580/1184] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:51 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:51.822931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-66f47a0f-a415-4582-97c4-0c99b573238a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:51.823842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-66f47a0f-a415-4582-97c4-0c99b573238a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:51.830261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66f47a0f-a415-4582-97c4-0c99b573238a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:51.830719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66f47a0f-a415-4582-97c4-0c99b573238a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:51.831496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66f47a0f-a415-4582-97c4-0c99b573238a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:51.831937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66f47a0f-a415-4582-97c4-0c99b573238a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:51.859896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-66f47a0f-a415-4582-97c4-0c99b573238a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041417 Mar 08 20:05:51.860456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 605/1185] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:52.597674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:52.598284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:52.605252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:52.605700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:52.606487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:52.606902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:52.734430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:52.742225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e1fcc783-6c63-4cd4-8bd8-e0ac0ae62c1a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149119 Mar 08 20:05:52.742784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 581/1186] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:52 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:52.871177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3299cf03-6099-4753-8e4c-f801802fa36b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:52.872088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3299cf03-6099-4753-8e4c-f801802fa36b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:52.878378 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3299cf03-6099-4753-8e4c-f801802fa36b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:52.878837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3299cf03-6099-4753-8e4c-f801802fa36b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:52.879607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3299cf03-6099-4753-8e4c-f801802fa36b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:52.880050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3299cf03-6099-4753-8e4c-f801802fa36b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:52.908276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3299cf03-6099-4753-8e4c-f801802fa36b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041000 Mar 08 20:05:52.908844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 606/1187] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:53.758773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:53.759389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:53.765622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:53.766077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:53.766847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:53.767288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:53.898264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:53.906225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5047dcec-f30c-43c1-b5e9-4ea1833653d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151368 Mar 08 20:05:53.906786 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 582/1188] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:53 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:53.919549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d293d466-b841-4ea4-a420-128b0ee142aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:53.920500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d293d466-b841-4ea4-a420-128b0ee142aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:53.926805 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d293d466-b841-4ea4-a420-128b0ee142aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:53.927260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d293d466-b841-4ea4-a420-128b0ee142aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:53.928028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d293d466-b841-4ea4-a420-128b0ee142aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:53.928526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d293d466-b841-4ea4-a420-128b0ee142aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:53.957830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d293d466-b841-4ea4-a420-128b0ee142aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042163 Mar 08 20:05:53.958405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 607/1189] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:54.923299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:54.923832 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:54.930104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:54.930558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:54.931324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:54.931764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:54.969027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1270b52a-cd32-41e1-8b93-b3c7dd455d0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:54.969941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1270b52a-cd32-41e1-8b93-b3c7dd455d0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:54.976881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1270b52a-cd32-41e1-8b93-b3c7dd455d0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:54.977339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1270b52a-cd32-41e1-8b93-b3c7dd455d0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:54.978120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1270b52a-cd32-41e1-8b93-b3c7dd455d0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:54.978561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1270b52a-cd32-41e1-8b93-b3c7dd455d0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:55.006320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1270b52a-cd32-41e1-8b93-b3c7dd455d0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041096 Mar 08 20:05:55.006916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 608/1190] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:05:55.060169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:55.067809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b6e12e10-ff2a-4c09-ba7a-a85bcb6631af tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148391 Mar 08 20:05:55.068385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 583/1191] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:54 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:56.017639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-346f93e0-5c7a-40b9-b640-1774f949bd88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:56.018486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-346f93e0-5c7a-40b9-b640-1774f949bd88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:56.024770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-346f93e0-5c7a-40b9-b640-1774f949bd88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:56.025224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-346f93e0-5c7a-40b9-b640-1774f949bd88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:56.025998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-346f93e0-5c7a-40b9-b640-1774f949bd88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:56.026700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-346f93e0-5c7a-40b9-b640-1774f949bd88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:56.054939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-346f93e0-5c7a-40b9-b640-1774f949bd88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041279 Mar 08 20:05:56.055474 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 609/1192] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:56.084046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:56.084738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:56.090999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:56.091452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:56.092214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:56.092675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:56.229698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:56.237478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c31b19e3-6223-4407-b0f0-0c041236d901 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.157266 Mar 08 20:05:56.238041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 584/1193] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:56 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:57.066502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-542a3658-d978-4b4c-8769-abcd66df8217 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:57.067417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-542a3658-d978-4b4c-8769-abcd66df8217 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:57.073630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a3658-d978-4b4c-8769-abcd66df8217 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:57.074078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a3658-d978-4b4c-8769-abcd66df8217 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:57.074846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a3658-d978-4b4c-8769-abcd66df8217 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:57.075281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a3658-d978-4b4c-8769-abcd66df8217 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:57.103369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-542a3658-d978-4b4c-8769-abcd66df8217 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Mar 08 20:05:57.103901 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 610/1194] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:57.254728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:57.255280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:57.261581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:57.262034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:57.262800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:57.263239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:57.390099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:57.398388 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-86634a11-82c4-4fb0-ac93-f15c8daf2d33 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147612 Mar 08 20:05:57.398948 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 585/1195] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:57 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:58.114711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ea8c0c25-f2d2-498a-ac04-9b7ed6959f51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:58.115628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ea8c0c25-f2d2-498a-ac04-9b7ed6959f51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:58.122401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ea8c0c25-f2d2-498a-ac04-9b7ed6959f51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:58.122853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ea8c0c25-f2d2-498a-ac04-9b7ed6959f51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:58.123623 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ea8c0c25-f2d2-498a-ac04-9b7ed6959f51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:58.124062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ea8c0c25-f2d2-498a-ac04-9b7ed6959f51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:58.152419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ea8c0c25-f2d2-498a-ac04-9b7ed6959f51 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Mar 08 20:05:58.152965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 611/1196] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:58.416196 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:58.416837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:58.423114 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:58.423570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:58.424359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:58.424833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:58.553502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:58.561758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2b6db077-eed6-43b8-b6a2-1243ee6c67dd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150066 Mar 08 20:05:58.562326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 586/1197] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:58 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:05:58.960528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:05:58.960714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:05:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:05:59.164337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-83582e6f-627b-4b91-8d95-329700b328eb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:59.165241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-83582e6f-627b-4b91-8d95-329700b328eb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:59.171399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-83582e6f-627b-4b91-8d95-329700b328eb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:59.171848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-83582e6f-627b-4b91-8d95-329700b328eb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:59.172626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-83582e6f-627b-4b91-8d95-329700b328eb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:59.173060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-83582e6f-627b-4b91-8d95-329700b328eb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:59.201066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-83582e6f-627b-4b91-8d95-329700b328eb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041238 Mar 08 20:05:59.201580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 612/1198] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:05:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:05:59.579460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:05:59.580072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:05:59.586401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:59.586857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:59.587627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:05:59.588067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:05:59.976670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:05:59.984245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e803abcf-7828-40ba-801e-eecc0bdc6a17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.408764 Mar 08 20:05:59.984822 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 587/1199] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:05:59 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:00.213030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1438aab0-b87a-43a9-b45c-d1bea03ef446 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:00.213951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1438aab0-b87a-43a9-b45c-d1bea03ef446 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:00.220379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1438aab0-b87a-43a9-b45c-d1bea03ef446 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:00.220837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1438aab0-b87a-43a9-b45c-d1bea03ef446 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:00.221713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1438aab0-b87a-43a9-b45c-d1bea03ef446 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:00.222157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1438aab0-b87a-43a9-b45c-d1bea03ef446 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:00.250244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1438aab0-b87a-43a9-b45c-d1bea03ef446 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041764 Mar 08 20:06:00.250782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 613/1200] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:01.000868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:01.001407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:01.007808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:01.008263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:01.009056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:01.009494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:01.139319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:01.147611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9f16b7db-c504-498a-9ace-b75081aa375e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150110 Mar 08 20:06:01.148175 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 588/1201] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:00 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:01.261745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-56fff0b2-0b3f-448f-9aa9-d0f892882d37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:01.262581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-56fff0b2-0b3f-448f-9aa9-d0f892882d37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:01.268841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56fff0b2-0b3f-448f-9aa9-d0f892882d37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:01.269295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56fff0b2-0b3f-448f-9aa9-d0f892882d37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:01.270066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56fff0b2-0b3f-448f-9aa9-d0f892882d37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:01.270506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56fff0b2-0b3f-448f-9aa9-d0f892882d37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:01.299756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-56fff0b2-0b3f-448f-9aa9-d0f892882d37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Mar 08 20:06:01.300323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 614/1202] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:02.166594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:02.167310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:02.174555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:02.175009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:02.175914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:02.176453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:02.307886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:02.311851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bacb0810-68bc-44ba-b8fe-410acce6da65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:02.312859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bacb0810-68bc-44ba-b8fe-410acce6da65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:02.317095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-357228db-32a9-4382-a01c-63704375dff0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155239 Mar 08 20:06:02.317675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 589/1203] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:02 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:06:02.319555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacb0810-68bc-44ba-b8fe-410acce6da65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:02.320056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacb0810-68bc-44ba-b8fe-410acce6da65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:02.320862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacb0810-68bc-44ba-b8fe-410acce6da65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:02.321291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bacb0810-68bc-44ba-b8fe-410acce6da65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:02.349430 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bacb0810-68bc-44ba-b8fe-410acce6da65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Mar 08 20:06:02.349968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 615/1204] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:03.334572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:03.335189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:03.341522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:03.341977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:03.342747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:03.343182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:03.361201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7947c5f4-173a-42b0-9298-e54d5f8b3893 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:03.362114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7947c5f4-173a-42b0-9298-e54d5f8b3893 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:03.368997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7947c5f4-173a-42b0-9298-e54d5f8b3893 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:03.369435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7947c5f4-173a-42b0-9298-e54d5f8b3893 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:03.370217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7947c5f4-173a-42b0-9298-e54d5f8b3893 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:03.370657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7947c5f4-173a-42b0-9298-e54d5f8b3893 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:03.399636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7947c5f4-173a-42b0-9298-e54d5f8b3893 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Mar 08 20:06:03.400199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 616/1205] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:03.472552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:03.480664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6bba0759-d77c-4dd9-a4f5-b5ae26c2752a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149983 Mar 08 20:06:03.481216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 590/1206] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:03 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:04.411178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5f073a3d-8829-4626-ba54-4ad3df928de8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:04.412080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5f073a3d-8829-4626-ba54-4ad3df928de8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:04.418320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f073a3d-8829-4626-ba54-4ad3df928de8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:04.418763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f073a3d-8829-4626-ba54-4ad3df928de8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:04.419512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f073a3d-8829-4626-ba54-4ad3df928de8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:04.419940 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f073a3d-8829-4626-ba54-4ad3df928de8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:04.447438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5f073a3d-8829-4626-ba54-4ad3df928de8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040235 Mar 08 20:06:04.447975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 617/1207] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:04.497597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:04.498205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:04.504464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:04.504916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:04.505675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:04.506109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:04.639899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:04.647597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c04cc7d1-5195-43f1-bff8-d00e02c574f8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153891 Mar 08 20:06:04.648159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 591/1208] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:04 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:05.458788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f5cec266-9e6d-4ae8-9249-9aec0bcf35c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:05.460309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f5cec266-9e6d-4ae8-9249-9aec0bcf35c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:05.466638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f5cec266-9e6d-4ae8-9249-9aec0bcf35c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:05.467093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f5cec266-9e6d-4ae8-9249-9aec0bcf35c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:05.467858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f5cec266-9e6d-4ae8-9249-9aec0bcf35c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:05.468311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f5cec266-9e6d-4ae8-9249-9aec0bcf35c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:05.497373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f5cec266-9e6d-4ae8-9249-9aec0bcf35c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Mar 08 20:06:05.497925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 618/1209] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:05.664898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:05.665504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:05.671768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:05.672233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:05.673034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:05.673472 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:05.805511 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:05.813141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2a644fd7-4852-41a7-a290-05c220ec68d7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152220 Mar 08 20:06:05.813701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 592/1210] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:05 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:06.508900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b2d81394-f253-42de-ac88-8563660a3018 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:06.509754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b2d81394-f253-42de-ac88-8563660a3018 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:06.516179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2d81394-f253-42de-ac88-8563660a3018 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:06.516650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2d81394-f253-42de-ac88-8563660a3018 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:06.517402 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2d81394-f253-42de-ac88-8563660a3018 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:06.517833 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b2d81394-f253-42de-ac88-8563660a3018 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:06.545633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b2d81394-f253-42de-ac88-8563660a3018 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040773 Mar 08 20:06:06.546161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 619/1211] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:06.829640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:06.830248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:06.836652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:06.837100 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:06.837858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:06.838293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:06.963854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:06.971609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b59df196-ba5d-4172-9cee-3b874aadd7ce tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.145991 Mar 08 20:06:06.972166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 593/1212] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:06 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:07.557103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3fd9e7e6-9da2-40fd-8f60-03081f0a4689 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:07.558050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3fd9e7e6-9da2-40fd-8f60-03081f0a4689 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:07.564528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fd9e7e6-9da2-40fd-8f60-03081f0a4689 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:07.564979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fd9e7e6-9da2-40fd-8f60-03081f0a4689 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:07.565750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fd9e7e6-9da2-40fd-8f60-03081f0a4689 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:07.566189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fd9e7e6-9da2-40fd-8f60-03081f0a4689 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:07.594969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3fd9e7e6-9da2-40fd-8f60-03081f0a4689 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041824 Mar 08 20:06:07.595521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 620/1213] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:07.989671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:07.990284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:07.996579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:07.997029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:07.997800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:07.998235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:08.129400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:08.137741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bc2ea560-d157-439d-8d01-8fde602878d0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151912 Mar 08 20:06:08.138298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 594/1214] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:07 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:08.605783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9d2849c6-47b9-423e-a70a-cdeedfea152a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:08.606695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9d2849c6-47b9-423e-a70a-cdeedfea152a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:08.612944 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d2849c6-47b9-423e-a70a-cdeedfea152a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:08.613391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d2849c6-47b9-423e-a70a-cdeedfea152a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:08.614155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d2849c6-47b9-423e-a70a-cdeedfea152a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:08.614594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d2849c6-47b9-423e-a70a-cdeedfea152a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:08.643078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9d2849c6-47b9-423e-a70a-cdeedfea152a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041303 Mar 08 20:06:08.643613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 621/1215] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:09.155484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:09.156091 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:09.162370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:09.163437 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:09.164200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:09.164665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:09.293448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:09.301240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f2453c84-7f31-420b-a9d7-ff04e0511ed3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149879 Mar 08 20:06:09.301801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 595/1216] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:09 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:09.658006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f3fb527e-d2af-4bad-9a2a-4ed6744d4fe0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:09.659355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f3fb527e-d2af-4bad-9a2a-4ed6744d4fe0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:09.669582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3fb527e-d2af-4bad-9a2a-4ed6744d4fe0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:09.670028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3fb527e-d2af-4bad-9a2a-4ed6744d4fe0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:09.670795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3fb527e-d2af-4bad-9a2a-4ed6744d4fe0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:09.671226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3fb527e-d2af-4bad-9a2a-4ed6744d4fe0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:09.702044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f3fb527e-d2af-4bad-9a2a-4ed6744d4fe0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050539 Mar 08 20:06:09.702520 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 622/1217] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:10.318370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:10.318971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:10.325220 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:10.325662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:10.326423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:10.326854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:10.459007 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:10.467263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4f3dc9ff-2091-4098-a99c-0285e374153b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152665 Mar 08 20:06:10.467823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 596/1218] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:10 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:10.713437 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f82e30bb-a941-44eb-becf-c911ff5bfb66 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:10.714352 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f82e30bb-a941-44eb-becf-c911ff5bfb66 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:10.720617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f82e30bb-a941-44eb-becf-c911ff5bfb66 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:10.721065 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f82e30bb-a941-44eb-becf-c911ff5bfb66 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:10.721839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f82e30bb-a941-44eb-becf-c911ff5bfb66 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:10.722281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f82e30bb-a941-44eb-becf-c911ff5bfb66 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:10.749882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f82e30bb-a941-44eb-becf-c911ff5bfb66 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040491 Mar 08 20:06:10.750425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 623/1219] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:11.484058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:11.484697 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:11.491528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:11.491983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:11.492787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:11.493226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:11.625239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:11.633643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d018459a-1e0e-4080-88f8-3324bf7b45eb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153435 Mar 08 20:06:11.634199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 597/1220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:11 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:11.761375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-aae43b54-600d-45b4-9898-488b917ad5bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:11.762293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-aae43b54-600d-45b4-9898-488b917ad5bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:11.768647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aae43b54-600d-45b4-9898-488b917ad5bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:11.769132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aae43b54-600d-45b4-9898-488b917ad5bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:11.769906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aae43b54-600d-45b4-9898-488b917ad5bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:11.770348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aae43b54-600d-45b4-9898-488b917ad5bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:11.798571 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-aae43b54-600d-45b4-9898-488b917ad5bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041185 Mar 08 20:06:11.799116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 624/1221] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:12.650831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:12.651620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:12.657837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:12.658278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:12.659030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:12.659458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:12.788755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:12.796448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-31abcad2-eeae-4085-9d59-92d790dbdb24 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150075 Mar 08 20:06:12.797009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 598/1222] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:12 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:12.812158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6db21d96-3d6d-40c4-b7c1-654ca08dd114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:12.813110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6db21d96-3d6d-40c4-b7c1-654ca08dd114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:12.819741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6db21d96-3d6d-40c4-b7c1-654ca08dd114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:12.820191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6db21d96-3d6d-40c4-b7c1-654ca08dd114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:12.820991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6db21d96-3d6d-40c4-b7c1-654ca08dd114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:12.821427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6db21d96-3d6d-40c4-b7c1-654ca08dd114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:12.849175 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6db21d96-3d6d-40c4-b7c1-654ca08dd114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040935 Mar 08 20:06:12.849716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 625/1223] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:13.812377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:13.812918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:13.819164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:13.819647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:13.820447 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:13.820888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:13.860589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e6879c46-beef-439f-9f24-b9b971482778 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:13.861541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e6879c46-beef-439f-9f24-b9b971482778 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:13.867765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6879c46-beef-439f-9f24-b9b971482778 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:13.868213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6879c46-beef-439f-9f24-b9b971482778 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:13.869089 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6879c46-beef-439f-9f24-b9b971482778 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:13.869523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6879c46-beef-439f-9f24-b9b971482778 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:13.898823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e6879c46-beef-439f-9f24-b9b971482778 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Mar 08 20:06:13.899427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 626/1224] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:13.951902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:13.960172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-91f3146f-318e-40aa-a113-2dcbd6d57d4d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151226 Mar 08 20:06:13.960795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 599/1225] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:13 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:14.910558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-873743c0-1e13-40e1-9a63-fd986b6f556d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:14.911460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-873743c0-1e13-40e1-9a63-fd986b6f556d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:14.918161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-873743c0-1e13-40e1-9a63-fd986b6f556d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:14.918602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-873743c0-1e13-40e1-9a63-fd986b6f556d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:14.919360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-873743c0-1e13-40e1-9a63-fd986b6f556d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:14.919786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-873743c0-1e13-40e1-9a63-fd986b6f556d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:14.947399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-873743c0-1e13-40e1-9a63-fd986b6f556d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040830 Mar 08 20:06:14.947925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 627/1226] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:14.977363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:14.977980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:14.984151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:14.984634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:14.985399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:14.985836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:15.114094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:15.122008 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-21880700-87c3-4f3d-8967-3c549c57b6c0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148995 Mar 08 20:06:15.122568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 600/1227] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:14 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:15.958900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bc7a9882-0e1c-4d71-a377-f2aaf7760fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:15.960376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bc7a9882-0e1c-4d71-a377-f2aaf7760fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:15.966719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc7a9882-0e1c-4d71-a377-f2aaf7760fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:15.967167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc7a9882-0e1c-4d71-a377-f2aaf7760fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:15.967938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc7a9882-0e1c-4d71-a377-f2aaf7760fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:15.968400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bc7a9882-0e1c-4d71-a377-f2aaf7760fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:15.996208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bc7a9882-0e1c-4d71-a377-f2aaf7760fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Mar 08 20:06:15.996781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 628/1228] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:16.138751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:16.139354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:16.145656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:16.146108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:16.147378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:16.147820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:16.279924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:16.287704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5850e0bf-1b47-473b-b60f-7001984386bd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152902 Mar 08 20:06:16.288270 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 601/1229] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:16 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:17.007496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-52f90285-a3e7-4529-a3bc-0096c868606d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:17.008353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-52f90285-a3e7-4529-a3bc-0096c868606d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:17.014525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-52f90285-a3e7-4529-a3bc-0096c868606d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:17.014968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-52f90285-a3e7-4529-a3bc-0096c868606d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:17.015723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-52f90285-a3e7-4529-a3bc-0096c868606d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:17.016154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-52f90285-a3e7-4529-a3bc-0096c868606d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:17.043899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-52f90285-a3e7-4529-a3bc-0096c868606d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040870 Mar 08 20:06:17.044456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 629/1230] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:17.304398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:17.304998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:17.311403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:17.311846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:17.312648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:17.313079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:17.440835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:17.448463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4bc876d5-86ba-4c75-b0b0-787530242d7b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148602 Mar 08 20:06:17.449019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 602/1231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:17 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:18.054959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2ce42885-4dbb-4c4c-aa00-c1520f041b2d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:18.055787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2ce42885-4dbb-4c4c-aa00-c1520f041b2d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:18.061932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce42885-4dbb-4c4c-aa00-c1520f041b2d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:18.062383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce42885-4dbb-4c4c-aa00-c1520f041b2d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:18.063136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce42885-4dbb-4c4c-aa00-c1520f041b2d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:18.063567 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ce42885-4dbb-4c4c-aa00-c1520f041b2d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:18.091536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2ce42885-4dbb-4c4c-aa00-c1520f041b2d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040559 Mar 08 20:06:18.092069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 630/1232] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:18.465720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:18.466333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:18.472710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:18.473159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:18.473958 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:18.474395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:18.607198 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:18.615002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7abd79a5-a541-4031-97b2-ce91d35e019b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153196 Mar 08 20:06:18.615625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 603/1233] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:18 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:19.102798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1495e675-b0df-4030-af54-68d4332e1bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:19.103701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1495e675-b0df-4030-af54-68d4332e1bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:19.110012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1495e675-b0df-4030-af54-68d4332e1bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:19.110459 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1495e675-b0df-4030-af54-68d4332e1bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:19.111216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1495e675-b0df-4030-af54-68d4332e1bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:19.111687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1495e675-b0df-4030-af54-68d4332e1bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:19.140137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1495e675-b0df-4030-af54-68d4332e1bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041177 Mar 08 20:06:19.140638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 631/1234] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:19.631251 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:19.631850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:19.638279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:19.638731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:19.639508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:19.639945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:19.774300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:19.782776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b815e5cc-95c9-448c-bbe8-5e3a3ed36c7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155374 Mar 08 20:06:19.783340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 604/1235] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:19 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:20.151632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7db956ee-eb76-4e2a-b7fd-cd4e7dd07ebb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:20.152569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7db956ee-eb76-4e2a-b7fd-cd4e7dd07ebb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:20.158844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7db956ee-eb76-4e2a-b7fd-cd4e7dd07ebb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:20.159296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7db956ee-eb76-4e2a-b7fd-cd4e7dd07ebb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:20.160057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7db956ee-eb76-4e2a-b7fd-cd4e7dd07ebb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:20.160516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7db956ee-eb76-4e2a-b7fd-cd4e7dd07ebb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:20.187631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7db956ee-eb76-4e2a-b7fd-cd4e7dd07ebb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040782 Mar 08 20:06:20.188186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 632/1236] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:20.800013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:20.800650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:20.807581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:20.808037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:20.808826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:20.809271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:20.936387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:20.943957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5259bd3b-3346-4886-a8a5-ef3579695633 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147757 Mar 08 20:06:20.944553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 605/1237] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:20 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:21.199407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-382a5547-fe28-43a8-afe1-94d3d1404c82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:21.200234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-382a5547-fe28-43a8-afe1-94d3d1404c82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:21.205986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-382a5547-fe28-43a8-afe1-94d3d1404c82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:21.206429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-382a5547-fe28-43a8-afe1-94d3d1404c82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:21.207182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-382a5547-fe28-43a8-afe1-94d3d1404c82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:21.207613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-382a5547-fe28-43a8-afe1-94d3d1404c82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:21.235523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-382a5547-fe28-43a8-afe1-94d3d1404c82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040384 Mar 08 20:06:21.236056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 633/1238] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:21.961201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:21.961847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:21.968073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:21.968556 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:21.969319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:21.969782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:22.102280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:22.110203 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5fd2b2e9-dd83-45e0-bd0d-3f49d72478be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153276 Mar 08 20:06:22.110778 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 606/1239] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:21 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:22.247218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c59ab1a5-51eb-402a-8abe-01dc3736587d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:22.248168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c59ab1a5-51eb-402a-8abe-01dc3736587d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:22.254444 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c59ab1a5-51eb-402a-8abe-01dc3736587d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:22.254899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c59ab1a5-51eb-402a-8abe-01dc3736587d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:22.255667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c59ab1a5-51eb-402a-8abe-01dc3736587d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:22.256642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c59ab1a5-51eb-402a-8abe-01dc3736587d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:22.284586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c59ab1a5-51eb-402a-8abe-01dc3736587d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Mar 08 20:06:22.285130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 634/1240] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:23.126881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:23.127496 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:23.134321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:23.134773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:23.135542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:23.135981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:23.264243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:23.271973 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1a1f3713-ebc2-483e-9277-9092896e4e52 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148921 Mar 08 20:06:23.272573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 607/1241] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:23 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:23.295295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dc65104e-0cf2-4074-a6d4-3f865430a163 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:23.296205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dc65104e-0cf2-4074-a6d4-3f865430a163 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:23.302433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc65104e-0cf2-4074-a6d4-3f865430a163 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:23.302830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc65104e-0cf2-4074-a6d4-3f865430a163 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:23.303650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc65104e-0cf2-4074-a6d4-3f865430a163 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:23.304086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc65104e-0cf2-4074-a6d4-3f865430a163 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:23.331857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dc65104e-0cf2-4074-a6d4-3f865430a163 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040435 Mar 08 20:06:23.332408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 635/1242] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:24.289038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:24.289645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:24.295947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:24.296437 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:24.297205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:24.297640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:24.343155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-46d724c5-c226-4b2c-866a-087f616c8b71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:24.344100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-46d724c5-c226-4b2c-866a-087f616c8b71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:24.350319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46d724c5-c226-4b2c-866a-087f616c8b71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:24.350826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46d724c5-c226-4b2c-866a-087f616c8b71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:24.351546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46d724c5-c226-4b2c-866a-087f616c8b71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:24.351992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-46d724c5-c226-4b2c-866a-087f616c8b71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:24.385951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-46d724c5-c226-4b2c-866a-087f616c8b71 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Mar 08 20:06:24.386713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 636/1243] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:24.437070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:24.445393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-20ab33e1-2931-42f4-a0c9-88c98e841dbe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.160220 Mar 08 20:06:24.445955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 608/1244] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:24 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:25.398104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b50ea8bd-19d5-473e-95d2-272080361566 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:25.399019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b50ea8bd-19d5-473e-95d2-272080361566 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:25.405476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b50ea8bd-19d5-473e-95d2-272080361566 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:25.405926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b50ea8bd-19d5-473e-95d2-272080361566 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:25.406691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b50ea8bd-19d5-473e-95d2-272080361566 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:25.407128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b50ea8bd-19d5-473e-95d2-272080361566 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:25.435405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b50ea8bd-19d5-473e-95d2-272080361566 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 Mar 08 20:06:25.435946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 637/1245] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:25.461746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:25.462359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:25.468627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:25.469084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:25.469854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:25.470292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:25.601340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:25.608927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8bf4b947-1a5b-4672-aa27-55501e452282 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151112 Mar 08 20:06:25.609482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 609/1246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:25 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:26.446917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1a69983b-d9a7-4060-99ba-d17e83ea5a03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:26.447835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1a69983b-d9a7-4060-99ba-d17e83ea5a03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:26.454112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a69983b-d9a7-4060-99ba-d17e83ea5a03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:26.454563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a69983b-d9a7-4060-99ba-d17e83ea5a03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:26.455332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a69983b-d9a7-4060-99ba-d17e83ea5a03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:26.455776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1a69983b-d9a7-4060-99ba-d17e83ea5a03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:26.488810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1a69983b-d9a7-4060-99ba-d17e83ea5a03 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045741 Mar 08 20:06:26.489360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 638/1247] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:26.674058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:26.674665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:26.681776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:26.682229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:26.683032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:26.683468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:26.813027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:26.820779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-68eb1d14-526b-4495-a32c-21a7b7abfa95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150614 Mar 08 20:06:26.821341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 610/1248] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:26 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:27.500123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-37586e39-45c6-492a-b96e-c7139f42ba85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:27.501073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-37586e39-45c6-492a-b96e-c7139f42ba85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:27.508176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37586e39-45c6-492a-b96e-c7139f42ba85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:27.508659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37586e39-45c6-492a-b96e-c7139f42ba85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:27.509448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37586e39-45c6-492a-b96e-c7139f42ba85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:27.509894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37586e39-45c6-492a-b96e-c7139f42ba85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:27.543059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-37586e39-45c6-492a-b96e-c7139f42ba85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046926 Mar 08 20:06:27.543614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 639/1249] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:27.838361 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:27.838972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:27.845354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:27.845799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:27.846563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:27.846994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:27.979693 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:27.987465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-01660848-bf36-4fa8-95c2-c4988088f72e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153759 Mar 08 20:06:27.988030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 611/1250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:27 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:28.555273 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-384c9c4c-fce8-424b-a01a-0a4bbf2c874c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:28.556179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-384c9c4c-fce8-424b-a01a-0a4bbf2c874c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:28.562376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-384c9c4c-fce8-424b-a01a-0a4bbf2c874c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:28.562819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-384c9c4c-fce8-424b-a01a-0a4bbf2c874c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:28.563576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-384c9c4c-fce8-424b-a01a-0a4bbf2c874c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:28.564038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-384c9c4c-fce8-424b-a01a-0a4bbf2c874c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:28.592354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-384c9c4c-fce8-424b-a01a-0a4bbf2c874c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 Mar 08 20:06:28.592910 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 640/1251] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:29.004884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:29.005494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:29.011784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:29.012240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:29.013035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:29.013473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:29.146788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:29.154875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ea8afa3a-5ec0-4895-b628-d95f5dfa8bb8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153825 Mar 08 20:06:29.155443 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 612/1252] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:28 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:29.604372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-06a6f5cf-42c2-425f-8f03-bbd02f86b568 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:29.605227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-06a6f5cf-42c2-425f-8f03-bbd02f86b568 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:29.611593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06a6f5cf-42c2-425f-8f03-bbd02f86b568 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:29.612225 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06a6f5cf-42c2-425f-8f03-bbd02f86b568 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:29.613019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06a6f5cf-42c2-425f-8f03-bbd02f86b568 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:29.613453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06a6f5cf-42c2-425f-8f03-bbd02f86b568 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:29.641259 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-06a6f5cf-42c2-425f-8f03-bbd02f86b568 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 Mar 08 20:06:29.641808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 641/1253] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:30.172423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:30.173037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:30.179323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:30.179771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:30.180564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:30.181002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:30.314081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:30.321865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c074d2a4-2d90-428b-9441-2bbe9db2d67f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153469 Mar 08 20:06:30.322444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 613/1254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:30 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:30.652707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7c0d2160-e0d7-4b51-a93f-fa9ddc8b1ec4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:30.653551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7c0d2160-e0d7-4b51-a93f-fa9ddc8b1ec4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:30.659770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c0d2160-e0d7-4b51-a93f-fa9ddc8b1ec4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:30.660226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c0d2160-e0d7-4b51-a93f-fa9ddc8b1ec4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:30.661022 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c0d2160-e0d7-4b51-a93f-fa9ddc8b1ec4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:30.661462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c0d2160-e0d7-4b51-a93f-fa9ddc8b1ec4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:30.689950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7c0d2160-e0d7-4b51-a93f-fa9ddc8b1ec4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Mar 08 20:06:30.690495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 642/1255] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:31.337681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:31.338288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:31.344495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:31.344946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:31.345708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:31.346141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:31.476035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:31.484001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-383e73be-2827-4261-a60f-e20c5d4b9195 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150065 Mar 08 20:06:31.484606 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 614/1256] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:31 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:31.700950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fe9de5a5-910b-4ef4-b716-858e2f2d54e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:31.701861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fe9de5a5-910b-4ef4-b716-858e2f2d54e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:31.708012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe9de5a5-910b-4ef4-b716-858e2f2d54e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:31.708507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe9de5a5-910b-4ef4-b716-858e2f2d54e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:31.709895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe9de5a5-910b-4ef4-b716-858e2f2d54e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:31.710366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fe9de5a5-910b-4ef4-b716-858e2f2d54e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:31.738786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fe9de5a5-910b-4ef4-b716-858e2f2d54e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041731 Mar 08 20:06:31.739341 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 643/1257] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:32.501571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:32.502174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:32.509306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:32.509751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:32.510518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:32.510945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:32.644662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:32.652603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dd559d5e-9c4c-41dc-bec3-0f115e12b847 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154786 Mar 08 20:06:32.653166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 615/1258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:32 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:32.750128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-16af769a-fa99-47ab-8665-d10b1f33a212 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:32.751043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-16af769a-fa99-47ab-8665-d10b1f33a212 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:32.757286 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16af769a-fa99-47ab-8665-d10b1f33a212 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:32.757742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16af769a-fa99-47ab-8665-d10b1f33a212 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:32.758509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16af769a-fa99-47ab-8665-d10b1f33a212 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:32.758951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16af769a-fa99-47ab-8665-d10b1f33a212 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:32.786546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-16af769a-fa99-47ab-8665-d10b1f33a212 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040332 Mar 08 20:06:32.787601 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 644/1259] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:33.669250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:33.669794 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:33.676057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:33.676546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:33.677319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:33.678364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:33.798154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6b0e7c14-9142-43a9-926d-d1829bbb47f2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:33.799124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6b0e7c14-9142-43a9-926d-d1829bbb47f2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:33.805970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b0e7c14-9142-43a9-926d-d1829bbb47f2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:33.806396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:33.806546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b0e7c14-9142-43a9-926d-d1829bbb47f2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:33.807175 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b0e7c14-9142-43a9-926d-d1829bbb47f2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:33.807610 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b0e7c14-9142-43a9-926d-d1829bbb47f2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:33.814330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7dfa2438-35dc-4633-b113-969c0bda7fa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148977 Mar 08 20:06:33.814901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 616/1260] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:33 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:33.835771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6b0e7c14-9142-43a9-926d-d1829bbb47f2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041531 Mar 08 20:06:33.836328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 645/1261] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:34.830990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:34.831605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:34.838359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:34.838824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:34.839597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:34.840067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:34.846916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-271b5e50-8a5b-4a57-a971-3c7ee4ae7c27 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:34.847917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-271b5e50-8a5b-4a57-a971-3c7ee4ae7c27 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:34.854222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-271b5e50-8a5b-4a57-a971-3c7ee4ae7c27 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:34.854682 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-271b5e50-8a5b-4a57-a971-3c7ee4ae7c27 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:34.855457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-271b5e50-8a5b-4a57-a971-3c7ee4ae7c27 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:34.855895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-271b5e50-8a5b-4a57-a971-3c7ee4ae7c27 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:34.885303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-271b5e50-8a5b-4a57-a971-3c7ee4ae7c27 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042178 Mar 08 20:06:34.885872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 646/1262] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:34.975379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:34.983088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a2241ae2-e86c-4b73-b0a4-ecde7a54476d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.156014 Mar 08 20:06:34.983651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 617/1263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:34 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:35.896885 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c0008e35-ef44-40a2-b2c0-229aefb13e30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:35.897790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c0008e35-ef44-40a2-b2c0-229aefb13e30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:35.904198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0008e35-ef44-40a2-b2c0-229aefb13e30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:35.904675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0008e35-ef44-40a2-b2c0-229aefb13e30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:35.905439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0008e35-ef44-40a2-b2c0-229aefb13e30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:35.905870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c0008e35-ef44-40a2-b2c0-229aefb13e30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:35.934050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c0008e35-ef44-40a2-b2c0-229aefb13e30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041137 Mar 08 20:06:35.934584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 647/1264] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:35.999880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:36.000514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:36.010124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:36.010574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:36.011335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:36.011764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:36.144117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:36.153066 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8c44283a-4ede-4f6f-a109-ac147f8508e3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.156962 Mar 08 20:06:36.153570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 618/1265] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:35 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:36.945605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-49ac0234-1e81-48ee-ac75-ce62823a56a1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:36.946512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-49ac0234-1e81-48ee-ac75-ce62823a56a1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:36.952746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ac0234-1e81-48ee-ac75-ce62823a56a1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:36.953199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ac0234-1e81-48ee-ac75-ce62823a56a1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:36.953957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ac0234-1e81-48ee-ac75-ce62823a56a1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:36.954394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49ac0234-1e81-48ee-ac75-ce62823a56a1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:36.983202 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-49ac0234-1e81-48ee-ac75-ce62823a56a1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Mar 08 20:06:36.983742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 648/1266] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:37.169818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:37.170427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:37.176464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:37.176921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:37.178182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:37.178619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:37.306144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:37.313818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4d565e34-5dc6-497f-b1cc-15dcdedb1b75 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147837 Mar 08 20:06:37.314369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 619/1267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:37 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:37.994931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-22ce2076-6d09-4e89-b812-145250e9b0f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:37.995871 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-22ce2076-6d09-4e89-b812-145250e9b0f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:38.002201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-22ce2076-6d09-4e89-b812-145250e9b0f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:38.002655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-22ce2076-6d09-4e89-b812-145250e9b0f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:38.003422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-22ce2076-6d09-4e89-b812-145250e9b0f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:38.003862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-22ce2076-6d09-4e89-b812-145250e9b0f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:38.032763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-22ce2076-6d09-4e89-b812-145250e9b0f0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 Mar 08 20:06:38.033298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 649/1268] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:38.330233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:38.330847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:38.337690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:38.338142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:38.338904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:38.339346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:38.471767 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:38.480145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d3048ad5-2f94-42a3-8fe3-4f9b8c579991 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153846 Mar 08 20:06:38.480745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 620/1269] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:38 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:39.044164 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d62358ee-a717-4cc1-a401-27e6d38c29e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:39.045030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d62358ee-a717-4cc1-a401-27e6d38c29e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:39.051310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d62358ee-a717-4cc1-a401-27e6d38c29e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:39.051766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d62358ee-a717-4cc1-a401-27e6d38c29e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:39.052559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d62358ee-a717-4cc1-a401-27e6d38c29e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:39.053001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d62358ee-a717-4cc1-a401-27e6d38c29e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:39.082092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d62358ee-a717-4cc1-a401-27e6d38c29e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Mar 08 20:06:39.082650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 650/1270] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:39.496998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:39.497604 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:39.503979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:39.504462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:39.505227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:39.506226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:39.640628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:39.649161 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d641114f-4d24-4f8e-ace4-fa7361fdbb17 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.156037 Mar 08 20:06:39.649838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 621/1271] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:39 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:40.094142 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ec9d9ae1-d6ad-4d5d-922b-66176fd645fa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:40.095052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ec9d9ae1-d6ad-4d5d-922b-66176fd645fa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:40.101447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec9d9ae1-d6ad-4d5d-922b-66176fd645fa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:40.101899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec9d9ae1-d6ad-4d5d-922b-66176fd645fa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:40.102667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec9d9ae1-d6ad-4d5d-922b-66176fd645fa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:40.103103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ec9d9ae1-d6ad-4d5d-922b-66176fd645fa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:40.132021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ec9d9ae1-d6ad-4d5d-922b-66176fd645fa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Mar 08 20:06:40.132606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 651/1272] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:40.666836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:40.666836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:40.674050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:40.674492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:40.675266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:40.675702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:40.806037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:40.813764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-60e9afb0-09e0-489f-a03b-d49311fc3508 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151371 Mar 08 20:06:40.814330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 622/1273] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:40 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:41.143091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0eba3c83-a94b-4c48-b864-fee2cd533082 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:41.144003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0eba3c83-a94b-4c48-b864-fee2cd533082 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:41.151212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eba3c83-a94b-4c48-b864-fee2cd533082 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:41.151673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eba3c83-a94b-4c48-b864-fee2cd533082 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:41.152453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eba3c83-a94b-4c48-b864-fee2cd533082 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:41.152890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0eba3c83-a94b-4c48-b864-fee2cd533082 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:41.181714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0eba3c83-a94b-4c48-b864-fee2cd533082 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Mar 08 20:06:41.182382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 652/1274] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:41.830480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:41.831095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:41.837353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:41.837810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:41.838577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:41.839018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:41.968728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:41.976935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d77bd6da-d3fe-461c-b5cb-567d8f8537c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150294 Mar 08 20:06:41.977499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 623/1275] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:41 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:42.193378 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0d3b827c-c5aa-4de0-ab6d-4459bca0ac82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:42.194285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0d3b827c-c5aa-4de0-ab6d-4459bca0ac82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:42.200581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d3b827c-c5aa-4de0-ab6d-4459bca0ac82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:42.201026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d3b827c-c5aa-4de0-ab6d-4459bca0ac82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:42.201778 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d3b827c-c5aa-4de0-ab6d-4459bca0ac82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:42.202209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0d3b827c-c5aa-4de0-ab6d-4459bca0ac82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:42.229640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0d3b827c-c5aa-4de0-ab6d-4459bca0ac82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040251 Mar 08 20:06:42.230116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 653/1276] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:42.993671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:42.994283 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:43.000506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:43.000947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:43.001703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:43.002130 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:43.136754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:43.144455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d899a745-1751-410e-845d-097da7ec81e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154600 Mar 08 20:06:43.145038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 624/1277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:42 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:43.241148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c7768763-52c0-4713-a722-9f448f289d3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:43.242008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c7768763-52c0-4713-a722-9f448f289d3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:43.248251 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7768763-52c0-4713-a722-9f448f289d3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:43.248740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7768763-52c0-4713-a722-9f448f289d3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:43.249509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7768763-52c0-4713-a722-9f448f289d3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:43.249947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c7768763-52c0-4713-a722-9f448f289d3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:43.279138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c7768763-52c0-4713-a722-9f448f289d3d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Mar 08 20:06:43.279681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 654/1278] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:44.162094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:44.162695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:44.168908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:44.169377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:44.170139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:44.170569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:44.290510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3255ebfe-7503-48d2-8b98-842f396fbb42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:44.291439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3255ebfe-7503-48d2-8b98-842f396fbb42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:44.297691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3255ebfe-7503-48d2-8b98-842f396fbb42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:44.298151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3255ebfe-7503-48d2-8b98-842f396fbb42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:44.298877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:44.299006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3255ebfe-7503-48d2-8b98-842f396fbb42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:44.299355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3255ebfe-7503-48d2-8b98-842f396fbb42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:44.307240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c803f3c8-15c9-4e75-9c64-3c4aa7622c8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149061 Mar 08 20:06:44.307801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 625/1279] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:44 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:44.328874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3255ebfe-7503-48d2-8b98-842f396fbb42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042305 Mar 08 20:06:44.329425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 655/1280] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:45.324665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:45.325369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:45.331489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:45.331945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:45.332748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:45.333184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:45.340684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-87e279f3-937f-4da3-9e27-928433beb6a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:45.341601 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-87e279f3-937f-4da3-9e27-928433beb6a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:45.347724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87e279f3-937f-4da3-9e27-928433beb6a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:45.348181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87e279f3-937f-4da3-9e27-928433beb6a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:45.348984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87e279f3-937f-4da3-9e27-928433beb6a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:45.349425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87e279f3-937f-4da3-9e27-928433beb6a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:45.377484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-87e279f3-937f-4da3-9e27-928433beb6a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040691 Mar 08 20:06:45.378063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 656/1281] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:45.464537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:45.472307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5b5083e8-afb0-4561-9a4f-934bbaba2f47 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151520 Mar 08 20:06:45.472879 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 626/1282] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:45 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:46.389493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-45cd2be9-033b-4809-be9c-3ab55ebf3f82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:46.390403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-45cd2be9-033b-4809-be9c-3ab55ebf3f82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:46.397064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45cd2be9-033b-4809-be9c-3ab55ebf3f82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:46.397508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45cd2be9-033b-4809-be9c-3ab55ebf3f82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:46.398260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45cd2be9-033b-4809-be9c-3ab55ebf3f82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:46.398694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45cd2be9-033b-4809-be9c-3ab55ebf3f82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:46.426435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-45cd2be9-033b-4809-be9c-3ab55ebf3f82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Mar 08 20:06:46.426963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 657/1283] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:46.488932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:46.489539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:46.495807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:46.496256 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:46.497058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:46.497491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:46.642386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:46.655275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-acb8f600-2353-49f9-9883-ac05bdada1c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.168952 Mar 08 20:06:46.655859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 627/1284] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:46 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:47.438518 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b847456f-68c8-43c7-8cfb-9a4cb9745418 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:47.439429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b847456f-68c8-43c7-8cfb-9a4cb9745418 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:47.445763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b847456f-68c8-43c7-8cfb-9a4cb9745418 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:47.446212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b847456f-68c8-43c7-8cfb-9a4cb9745418 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:47.446978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b847456f-68c8-43c7-8cfb-9a4cb9745418 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:47.447419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b847456f-68c8-43c7-8cfb-9a4cb9745418 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:47.475149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b847456f-68c8-43c7-8cfb-9a4cb9745418 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040700 Mar 08 20:06:47.475703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 658/1285] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:47.674262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:47.674892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:47.681731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:47.682181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:47.682941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:47.683374 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:47.812016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:47.819678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ab70aa2e-d8e1-436a-9bf8-f0de3b283857 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149297 Mar 08 20:06:47.820237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 628/1286] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:47 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:48.486731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d4b47666-df2a-4d02-b2e2-716e941cb784 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:48.487671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d4b47666-df2a-4d02-b2e2-716e941cb784 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:48.494589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4b47666-df2a-4d02-b2e2-716e941cb784 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:48.495040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4b47666-df2a-4d02-b2e2-716e941cb784 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:48.495800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4b47666-df2a-4d02-b2e2-716e941cb784 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:48.496236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4b47666-df2a-4d02-b2e2-716e941cb784 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:48.524060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d4b47666-df2a-4d02-b2e2-716e941cb784 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041314 Mar 08 20:06:48.524636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 659/1287] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:48.836945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:48.837600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:48.843922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:48.844411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:48.845184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:48.845625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:48.977321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:48.984991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-967228a3-e07b-43cb-bdff-a92959ad1a2a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152508 Mar 08 20:06:48.985555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 629/1288] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:48 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:49.535632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7ca0bf56-b066-4119-97d2-bcd7ed76dbee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:49.536510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7ca0bf56-b066-4119-97d2-bcd7ed76dbee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:49.543331 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ca0bf56-b066-4119-97d2-bcd7ed76dbee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:49.543783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ca0bf56-b066-4119-97d2-bcd7ed76dbee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:49.544594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ca0bf56-b066-4119-97d2-bcd7ed76dbee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:49.545034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ca0bf56-b066-4119-97d2-bcd7ed76dbee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:49.572680 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7ca0bf56-b066-4119-97d2-bcd7ed76dbee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041003 Mar 08 20:06:49.573227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 660/1289] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:50.001827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:50.002441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:50.008718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:50.009165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:50.009928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:50.010362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:50.140561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:50.148793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-118e92c6-e686-4391-9527-c0330fb17f4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150854 Mar 08 20:06:50.149339 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 630/1290] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:49 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:50.584769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4f7bbc81-dc1d-41fb-b816-9bc82bca7055 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:50.585677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4f7bbc81-dc1d-41fb-b816-9bc82bca7055 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:50.591595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f7bbc81-dc1d-41fb-b816-9bc82bca7055 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:50.592041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f7bbc81-dc1d-41fb-b816-9bc82bca7055 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:50.592826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f7bbc81-dc1d-41fb-b816-9bc82bca7055 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:50.593257 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f7bbc81-dc1d-41fb-b816-9bc82bca7055 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:50.620166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4f7bbc81-dc1d-41fb-b816-9bc82bca7055 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040037 Mar 08 20:06:50.620735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 661/1291] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:51.167036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:51.168186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:51.181575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:51.181575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:51.181575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:51.181575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:51.307508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:51.315350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-808266b6-0bbe-458e-9cf8-04553afb0d0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152272 Mar 08 20:06:51.315932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 631/1292] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:51 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:51.631652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-db942e9a-640e-4e04-8caa-6cf005a0e276 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:51.632597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-db942e9a-640e-4e04-8caa-6cf005a0e276 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:51.638872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db942e9a-640e-4e04-8caa-6cf005a0e276 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:51.639321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db942e9a-640e-4e04-8caa-6cf005a0e276 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:51.640083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db942e9a-640e-4e04-8caa-6cf005a0e276 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:51.640636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db942e9a-640e-4e04-8caa-6cf005a0e276 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:51.668975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-db942e9a-640e-4e04-8caa-6cf005a0e276 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 Mar 08 20:06:51.669523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 662/1293] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:52.332271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:52.332895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:52.339614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:52.340061 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:52.340854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:52.341287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:52.473549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:52.481896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-71907c37-1bea-4d76-afcc-047699446e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153567 Mar 08 20:06:52.482456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 632/1294] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:52 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:52.679985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c97aab18-effe-498e-a2fb-84c902e8ddc2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:52.680842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c97aab18-effe-498e-a2fb-84c902e8ddc2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:52.687076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c97aab18-effe-498e-a2fb-84c902e8ddc2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:52.687531 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c97aab18-effe-498e-a2fb-84c902e8ddc2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:52.688315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c97aab18-effe-498e-a2fb-84c902e8ddc2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:52.688763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c97aab18-effe-498e-a2fb-84c902e8ddc2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:52.717140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c97aab18-effe-498e-a2fb-84c902e8ddc2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041174 Mar 08 20:06:52.717699 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 663/1295] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:53.498671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:53.499279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:53.505489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:53.505936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:53.506700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:53.507133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:53.635881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:53.644414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7e58da33-1858-4781-8f96-aaa71af49a61 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149397 Mar 08 20:06:53.645000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 633/1296] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:53 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:06:53.728774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-daf7a37b-355e-471b-949c-9c7603362097 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:53.729611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-daf7a37b-355e-471b-949c-9c7603362097 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:53.735819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-daf7a37b-355e-471b-949c-9c7603362097 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:53.736268 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-daf7a37b-355e-471b-949c-9c7603362097 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:53.737061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-daf7a37b-355e-471b-949c-9c7603362097 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:53.737498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-daf7a37b-355e-471b-949c-9c7603362097 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:53.765823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-daf7a37b-355e-471b-949c-9c7603362097 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 Mar 08 20:06:53.766360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 664/1297] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:54.663249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:54.663874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:54.670150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:54.670569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:54.671327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:54.671751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:54.777443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1efb30a7-20d5-42ba-9d14-ec7a1399b77f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:54.778475 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1efb30a7-20d5-42ba-9d14-ec7a1399b77f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:54.784970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1efb30a7-20d5-42ba-9d14-ec7a1399b77f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:54.785427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1efb30a7-20d5-42ba-9d14-ec7a1399b77f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:54.786232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1efb30a7-20d5-42ba-9d14-ec7a1399b77f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:54.787268 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1efb30a7-20d5-42ba-9d14-ec7a1399b77f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:54.803550 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:54.811335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-df173671-a88f-4388-8cdf-3d2f7f9710b7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152502 Mar 08 20:06:54.811907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 634/1298] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:54 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:54.815125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1efb30a7-20d5-42ba-9d14-ec7a1399b77f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 Mar 08 20:06:54.815664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 665/1299] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:06:55.825743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e613a5e5-ec8c-48d4-bf8c-637eaf7901b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:55.826717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e613a5e5-ec8c-48d4-bf8c-637eaf7901b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:55.827810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:55.828438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:55.833070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e613a5e5-ec8c-48d4-bf8c-637eaf7901b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:55.833533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e613a5e5-ec8c-48d4-bf8c-637eaf7901b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:55.834302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e613a5e5-ec8c-48d4-bf8c-637eaf7901b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:55.834613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:55.834732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e613a5e5-ec8c-48d4-bf8c-637eaf7901b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:55.835055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:55.835810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:55.836235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:55.862767 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e613a5e5-ec8c-48d4-bf8c-637eaf7901b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041029 Mar 08 20:06:55.863323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 635/1300] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:55.969888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:55.978036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ebd58e1c-9f5b-48ba-a966-8762cfdb3dd2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153968 Mar 08 20:06:55.978599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 666/1301] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:55 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:06:56.874796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-60e0213c-5bca-42d7-9009-ef6371175a0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:56.875712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-60e0213c-5bca-42d7-9009-ef6371175a0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:56.882587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e0213c-5bca-42d7-9009-ef6371175a0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:56.883041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e0213c-5bca-42d7-9009-ef6371175a0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:56.883809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e0213c-5bca-42d7-9009-ef6371175a0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:56.884250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60e0213c-5bca-42d7-9009-ef6371175a0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:56.911728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-60e0213c-5bca-42d7-9009-ef6371175a0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040892 Mar 08 20:06:56.912273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 636/1302] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:56.995187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:56.995764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:57.002069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:57.002522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:57.003288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:57.003728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:57.136077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:57.143734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f92e3361-3503-45f9-b268-b21bd3d40d60 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152441 Mar 08 20:06:57.144328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 667/1303] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:56 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:57.922966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-013797fd-338d-438a-bc2c-6935ec476311 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:57.923877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-013797fd-338d-438a-bc2c-6935ec476311 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:57.930721 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-013797fd-338d-438a-bc2c-6935ec476311 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:57.931198 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-013797fd-338d-438a-bc2c-6935ec476311 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:57.931974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-013797fd-338d-438a-bc2c-6935ec476311 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:57.932441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-013797fd-338d-438a-bc2c-6935ec476311 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:57.960827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-013797fd-338d-438a-bc2c-6935ec476311 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Mar 08 20:06:57.961381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 637/1304] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:58.160860 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:58.161961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:58.168228 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:58.168777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:58.169539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:58.169974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:58.308075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:58.315947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9b7d3af8-9612-4e08-b137-85eb9a9c7ec9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.158942 Mar 08 20:06:58.316550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 668/1305] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:58 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:06:58.972060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ecc97fe0-e1f4-4d2a-bada-1d771180e98c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:58.972998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ecc97fe0-e1f4-4d2a-bada-1d771180e98c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:58.979598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ecc97fe0-e1f4-4d2a-bada-1d771180e98c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:58.980041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ecc97fe0-e1f4-4d2a-bada-1d771180e98c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:58.980827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ecc97fe0-e1f4-4d2a-bada-1d771180e98c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:58.981256 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ecc97fe0-e1f4-4d2a-bada-1d771180e98c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:59.008831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ecc97fe0-e1f4-4d2a-bada-1d771180e98c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040726 Mar 08 20:06:59.009354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 638/1306] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:06:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:06:59.333546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:06:59.334159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:06:59.340415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:59.340866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:59.341628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:06:59.342064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:06:59.473360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:06:59.481059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-16eb2f77-b74e-4e10-be0d-49dcf042b0c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151849 Mar 08 20:06:59.481647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 669/1307] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:06:59 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:00.020142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4bb51597-3c50-482a-a29a-6a576dfc15b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:00.021041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4bb51597-3c50-482a-a29a-6a576dfc15b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:00.027541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bb51597-3c50-482a-a29a-6a576dfc15b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:00.027992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bb51597-3c50-482a-a29a-6a576dfc15b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:00.028792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bb51597-3c50-482a-a29a-6a576dfc15b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:00.029230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4bb51597-3c50-482a-a29a-6a576dfc15b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:00.056802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4bb51597-3c50-482a-a29a-6a576dfc15b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040678 Mar 08 20:07:00.057340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 639/1308] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:00.497948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:00.498545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:00.504936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:00.505387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:00.506157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:00.506593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:00.637607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:00.645337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0428501a-37c7-4aca-8cc5-9212570aff2f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151247 Mar 08 20:07:00.646438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 670/1309] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:00 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:01.068052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a16f0560-c317-400b-989e-8fb657c1798d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:01.068999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a16f0560-c317-400b-989e-8fb657c1798d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:01.075192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a16f0560-c317-400b-989e-8fb657c1798d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:01.075643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a16f0560-c317-400b-989e-8fb657c1798d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:01.076437 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a16f0560-c317-400b-989e-8fb657c1798d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:01.076881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a16f0560-c317-400b-989e-8fb657c1798d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:01.105864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a16f0560-c317-400b-989e-8fb657c1798d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Mar 08 20:07:01.106405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 640/1310] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:01.663174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:01.663781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:01.670303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:01.670735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:01.671492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:01.671921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:01.815530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:01.823364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-890abb0a-6b6e-438b-817e-1af174ef0ac0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.164491 Mar 08 20:07:01.823919 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 671/1311] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:01 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:02.117557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0ccf511a-aa63-44eb-ac0b-c799a413c59b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:02.118483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0ccf511a-aa63-44eb-ac0b-c799a413c59b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:02.124799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ccf511a-aa63-44eb-ac0b-c799a413c59b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:02.125250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ccf511a-aa63-44eb-ac0b-c799a413c59b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:02.126018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ccf511a-aa63-44eb-ac0b-c799a413c59b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:02.126456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ccf511a-aa63-44eb-ac0b-c799a413c59b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:02.154398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0ccf511a-aa63-44eb-ac0b-c799a413c59b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040902 Mar 08 20:07:02.154949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 641/1312] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:02.839989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:02.840712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:02.846716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:02.847266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:02.847908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:02.848370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:02.980398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:02.988153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-331edf95-0eb7-49c3-a517-3d884fa1ed4e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151948 Mar 08 20:07:02.988749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 672/1313] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:02 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:03.166211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e8690cb1-3203-4789-92b6-95b733edb27c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:03.167159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e8690cb1-3203-4789-92b6-95b733edb27c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:03.173427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8690cb1-3203-4789-92b6-95b733edb27c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:03.173880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8690cb1-3203-4789-92b6-95b733edb27c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:03.174650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8690cb1-3203-4789-92b6-95b733edb27c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:03.175090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8690cb1-3203-4789-92b6-95b733edb27c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:03.202993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e8690cb1-3203-4789-92b6-95b733edb27c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040702 Mar 08 20:07:03.203477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 642/1314] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:04.006039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:04.006583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:04.012861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:04.013316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:04.014114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:04.014556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:04.146471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:04.154506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fbfb1e9a-8683-4cde-9e3e-b54e961e39b8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152923 Mar 08 20:07:04.155072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 673/1315] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:04 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:04.214889 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-371d79f9-0dd9-4c9b-bf14-6b83da400a2f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:04.215854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-371d79f9-0dd9-4c9b-bf14-6b83da400a2f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:04.222775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-371d79f9-0dd9-4c9b-bf14-6b83da400a2f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:04.223225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-371d79f9-0dd9-4c9b-bf14-6b83da400a2f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:04.223994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-371d79f9-0dd9-4c9b-bf14-6b83da400a2f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:04.224464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-371d79f9-0dd9-4c9b-bf14-6b83da400a2f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:04.251891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-371d79f9-0dd9-4c9b-bf14-6b83da400a2f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040933 Mar 08 20:07:04.252458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 643/1316] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:05.171636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:05.172247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:05.178539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:05.178990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:05.179757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:05.180197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:05.263059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3620ad84-89b9-4762-b174-3b7d9008f438 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:05.264051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3620ad84-89b9-4762-b174-3b7d9008f438 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:05.270274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620ad84-89b9-4762-b174-3b7d9008f438 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:05.271235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620ad84-89b9-4762-b174-3b7d9008f438 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:05.272006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620ad84-89b9-4762-b174-3b7d9008f438 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:05.272551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620ad84-89b9-4762-b174-3b7d9008f438 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:05.301464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3620ad84-89b9-4762-b174-3b7d9008f438 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042297 Mar 08 20:07:05.302085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 644/1317] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:07:05.313099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:05.320975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4c040c62-d8cd-4639-ad10-dad63d236a53 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153186 Mar 08 20:07:05.321526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 674/1318] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:05 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:06.312830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-78279c1d-2f89-4133-9071-a0498896f13a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:06.313746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-78279c1d-2f89-4133-9071-a0498896f13a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:06.320032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78279c1d-2f89-4133-9071-a0498896f13a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:06.320518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78279c1d-2f89-4133-9071-a0498896f13a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:06.321285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78279c1d-2f89-4133-9071-a0498896f13a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:06.321724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78279c1d-2f89-4133-9071-a0498896f13a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:06.338078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:06.338687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:06.345005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:06.345567 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:06.346340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:06.346767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:06.350239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-78279c1d-2f89-4133-9071-a0498896f13a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041331 Mar 08 20:07:06.350988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 645/1319] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:06.476756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:06.484462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8f534cc8-99ed-491c-9bb4-5a911663bd0e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150183 Mar 08 20:07:06.485019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 675/1320] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:06 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:07:07.361851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3a4c3575-e5a2-46e0-bf8a-03af8ccfacfa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:07.362825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3a4c3575-e5a2-46e0-bf8a-03af8ccfacfa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:07.369253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a4c3575-e5a2-46e0-bf8a-03af8ccfacfa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:07.369706 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a4c3575-e5a2-46e0-bf8a-03af8ccfacfa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:07.370468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a4c3575-e5a2-46e0-bf8a-03af8ccfacfa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:07.370907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a4c3575-e5a2-46e0-bf8a-03af8ccfacfa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:07.402538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3a4c3575-e5a2-46e0-bf8a-03af8ccfacfa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Mar 08 20:07:07.403296 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 646/1321] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:07.501968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:07.502581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:07.509525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:07.509975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:07.510744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:07.511184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:07.645124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:07.653133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-801ce645-9a65-4b3a-9858-cc7722c057e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155053 Mar 08 20:07:07.653708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 676/1322] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:07 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:08.414370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6abef5fa-5f8f-4ce3-b663-fa88aa335084 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:08.415291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6abef5fa-5f8f-4ce3-b663-fa88aa335084 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:08.421612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6abef5fa-5f8f-4ce3-b663-fa88aa335084 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:08.422070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6abef5fa-5f8f-4ce3-b663-fa88aa335084 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:08.422837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6abef5fa-5f8f-4ce3-b663-fa88aa335084 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:08.423276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6abef5fa-5f8f-4ce3-b663-fa88aa335084 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:08.452566 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6abef5fa-5f8f-4ce3-b663-fa88aa335084 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Mar 08 20:07:08.453126 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 647/1323] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:08.671161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:08.671738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:08.679199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:08.680007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:08.681423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:08.682223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:08.813855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:08.821628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8e44e1ab-32a1-4904-ada2-143c2236646b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154370 Mar 08 20:07:08.822733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 677/1324] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:08 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:09.463729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8adbdeba-0fb4-4952-9b66-9971032872fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:09.464658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8adbdeba-0fb4-4952-9b66-9971032872fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:09.470843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8adbdeba-0fb4-4952-9b66-9971032872fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:09.471292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8adbdeba-0fb4-4952-9b66-9971032872fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:09.472048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8adbdeba-0fb4-4952-9b66-9971032872fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:09.472519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8adbdeba-0fb4-4952-9b66-9971032872fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:09.500660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8adbdeba-0fb4-4952-9b66-9971032872fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 Mar 08 20:07:09.501209 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 648/1325] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:09.839445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:09.840044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:09.846227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:09.846672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:09.847426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:09.847857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:09.976148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:09.983863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f7c7793c-76dd-4de3-b79e-e4a319e0dce1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148241 Mar 08 20:07:09.984442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 678/1326] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:09 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:10.511964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4140f373-c3f9-4ef5-bb7c-e44829561938 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:10.512858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4140f373-c3f9-4ef5-bb7c-e44829561938 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:10.519151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4140f373-c3f9-4ef5-bb7c-e44829561938 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:10.519582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4140f373-c3f9-4ef5-bb7c-e44829561938 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:10.520376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4140f373-c3f9-4ef5-bb7c-e44829561938 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:10.520816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4140f373-c3f9-4ef5-bb7c-e44829561938 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:10.548349 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4140f373-c3f9-4ef5-bb7c-e44829561938 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 Mar 08 20:07:10.548900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 649/1327] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:11.000882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:11.001484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:11.008151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:11.008624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:11.009386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:11.009818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:11.144517 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:11.152995 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8282c0ad-8fd0-4101-b89e-7cfcd7d7e51c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155984 Mar 08 20:07:11.153562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 679/1328] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:10 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:11.559602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bece8d54-f8c0-4081-9922-72805d7cb765 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:11.560538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bece8d54-f8c0-4081-9922-72805d7cb765 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:11.566833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bece8d54-f8c0-4081-9922-72805d7cb765 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:11.567277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bece8d54-f8c0-4081-9922-72805d7cb765 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:11.568042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bece8d54-f8c0-4081-9922-72805d7cb765 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:11.568504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bece8d54-f8c0-4081-9922-72805d7cb765 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:11.595911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bece8d54-f8c0-4081-9922-72805d7cb765 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040299 Mar 08 20:07:11.596507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 650/1329] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:12.127019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:12.127517 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:12.133840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.134293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.135067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.135502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.148245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] HTTP exception thrown: Instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 could not be found. Mar 08 20:07:12.148853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Returning 404 to user: Instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:07:12.149650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ef77f865-fac2-491b-bedb-0f5fb358249e tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 404 len: 111 microversion: 2.20 time: 0.026569 Mar 08 20:07:12.150425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 680/1330] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Mar 8 20:07:12 2022] DELETE /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:07:12.158344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:12.158944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] [instance: 7fb7515f-c5d4-4330-a70a-c1835a5556c4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:12.165230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.165673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.166428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.166857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.170023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:12.170636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:12.176264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.176751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.177522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.178055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.179860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] HTTP exception thrown: Instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 could not be found. Mar 08 20:07:12.180467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] Returning 404 to user: Instance 7fb7515f-c5d4-4330-a70a-c1835a5556c4 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:07:12.181267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e713577e-3839-41f6-b5cb-cfd56f556069 tempest-AttachVolumeShelveTestJSON-565309690 tempest-AttachVolumeShelveTestJSON-565309690-project] 10.222.0.45 "GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4" status: 404 len: 111 microversion: 2.20 time: 0.026781 Mar 08 20:07:12.181794 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 651/1331] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Mar 8 20:07:12 2022] GET /compute/v2.1/servers/7fb7515f-c5d4-4330-a70a-c1835a5556c4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:07:12.289672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:12.290312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:12.296747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.297264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.298139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.298645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.313980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance 30b992e6-93af-4c5c-8e4f-8004842e455e could not be found. Mar 08 20:07:12.314705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance 30b992e6-93af-4c5c-8e4f-8004842e455e could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:07:12.315613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-87be7efb-4090-4d85-99e7-b325dc855698 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 404 len: 111 microversion: 2.1 time: 0.031968 Mar 08 20:07:12.319282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 652/1332] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:07:12 2022] DELETE /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 20:07:12.322427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:12.324019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:12.324729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 30b992e6-93af-4c5c-8e4f-8004842e455e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:12.330585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1390eccc-5e8d-4bcf-a886-6c1168727340 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.164133 Mar 08 20:07:12.330969 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.331389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 681/1333] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:12 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:12.334566 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.335561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.336001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.349418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance 30b992e6-93af-4c5c-8e4f-8004842e455e could not be found. Mar 08 20:07:12.350520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance 30b992e6-93af-4c5c-8e4f-8004842e455e could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:07:12.351326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e1ff7ebb-bed3-4326-a6a1-f1e8f9597a2a tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e" status: 404 len: 111 microversion: 2.1 time: 0.031019 Mar 08 20:07:12.351855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 653/1334] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:12 2022] GET /compute/v2.1/servers/30b992e6-93af-4c5c-8e4f-8004842e455e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 20:07:12.607312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a4e51c79-e584-400d-a2dc-87968989feb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:12.608230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a4e51c79-e584-400d-a2dc-87968989feb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:12.614683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4e51c79-e584-400d-a2dc-87968989feb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.615169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4e51c79-e584-400d-a2dc-87968989feb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.616543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4e51c79-e584-400d-a2dc-87968989feb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:12.616985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4e51c79-e584-400d-a2dc-87968989feb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:12.646072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a4e51c79-e584-400d-a2dc-87968989feb5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Mar 08 20:07:12.646628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 682/1335] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:13.347466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:13.347851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:13.354382 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:13.354834 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:13.355619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:13.356057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:13.583723 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:13.591487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-57035b53-52d8-452a-b1a5-ebf968d2f965 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.248433 Mar 08 20:07:13.592047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 654/1336] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:13 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:13.657676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ef3c771f-3747-4cdd-ae43-54a8c2d754d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:13.658613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ef3c771f-3747-4cdd-ae43-54a8c2d754d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:13.665561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef3c771f-3747-4cdd-ae43-54a8c2d754d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:13.666042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef3c771f-3747-4cdd-ae43-54a8c2d754d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:13.666821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef3c771f-3747-4cdd-ae43-54a8c2d754d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:13.667372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ef3c771f-3747-4cdd-ae43-54a8c2d754d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:13.700249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ef3c771f-3747-4cdd-ae43-54a8c2d754d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Mar 08 20:07:13.701106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 683/1337] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:14.609051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:14.610509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:14.617947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:14.618660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:14.620107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:14.620641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:14.712590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0581d28f-973e-4c87-95f8-af6267c06de9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:14.714134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0581d28f-973e-4c87-95f8-af6267c06de9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:14.726466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0581d28f-973e-4c87-95f8-af6267c06de9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:14.727158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0581d28f-973e-4c87-95f8-af6267c06de9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:14.728272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0581d28f-973e-4c87-95f8-af6267c06de9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:14.728908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0581d28f-973e-4c87-95f8-af6267c06de9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:14.772927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0581d28f-973e-4c87-95f8-af6267c06de9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065661 Mar 08 20:07:14.773514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 684/1338] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:07:14.885415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:14.893188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cd916c74-963e-4504-ab92-6cc39fa8c445 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.288053 Mar 08 20:07:14.893751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 655/1339] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:14 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:15.784618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1b706ff4-41af-4858-bdb5-629ddd28656b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:15.785450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1b706ff4-41af-4858-bdb5-629ddd28656b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:15.792593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b706ff4-41af-4858-bdb5-629ddd28656b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:15.793043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b706ff4-41af-4858-bdb5-629ddd28656b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:15.793828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b706ff4-41af-4858-bdb5-629ddd28656b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:15.794283 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1b706ff4-41af-4858-bdb5-629ddd28656b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:15.823513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1b706ff4-41af-4858-bdb5-629ddd28656b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 Mar 08 20:07:15.824266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 685/1340] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:15.911458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:15.913288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:15.920645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:15.921262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:15.922037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:15.922471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:16.058039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:16.066319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-972a5129-4473-4acf-b1c0-afee9889d5a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.159070 Mar 08 20:07:16.066885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 656/1341] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:15 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:16.834711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dcbc44da-647f-4ca6-bc72-79a9255500b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:16.835935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dcbc44da-647f-4ca6-bc72-79a9255500b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:16.841803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbc44da-647f-4ca6-bc72-79a9255500b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:16.842255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbc44da-647f-4ca6-bc72-79a9255500b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:16.843015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbc44da-647f-4ca6-bc72-79a9255500b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:16.843445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbc44da-647f-4ca6-bc72-79a9255500b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:16.876624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dcbc44da-647f-4ca6-bc72-79a9255500b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Mar 08 20:07:16.877189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 686/1342] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:17.083677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:17.084885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:17.091316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:17.091761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:17.092557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:17.092995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:17.229645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:17.237632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b571e519-47de-4be3-80c7-ddc85a0ae732 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.157993 Mar 08 20:07:17.238197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 657/1343] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:17 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:07:17.887465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c16743f0-b98e-450b-9af6-ad35aa7d65a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:17.888550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c16743f0-b98e-450b-9af6-ad35aa7d65a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:17.894823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c16743f0-b98e-450b-9af6-ad35aa7d65a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:17.895276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c16743f0-b98e-450b-9af6-ad35aa7d65a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:17.896051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c16743f0-b98e-450b-9af6-ad35aa7d65a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:17.897023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c16743f0-b98e-450b-9af6-ad35aa7d65a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:17.926494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c16743f0-b98e-450b-9af6-ad35aa7d65a5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042868 Mar 08 20:07:17.927005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 687/1344] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:18.255083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:18.256188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:18.262473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:18.262933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:18.263701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:18.264134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:18.414049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:18.421796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-aa79fa8f-2cdc-49d5-999f-3c5f1a607b7d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.170860 Mar 08 20:07:18.422362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 658/1345] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:18 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:18.938512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1032798b-6692-4d0e-a504-5ae0774e3a30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:18.939510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1032798b-6692-4d0e-a504-5ae0774e3a30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:18.946239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1032798b-6692-4d0e-a504-5ae0774e3a30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:18.946763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1032798b-6692-4d0e-a504-5ae0774e3a30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:18.947665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1032798b-6692-4d0e-a504-5ae0774e3a30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:18.948177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1032798b-6692-4d0e-a504-5ae0774e3a30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:18.977060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1032798b-6692-4d0e-a504-5ae0774e3a30 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Mar 08 20:07:18.977612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 688/1346] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:19.439984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:19.440618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:19.448218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:19.448969 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:19.450118 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:19.450781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:19.590768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:19.598491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a3f3724e-745e-4b4c-9c33-7d763129a781 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.162429 Mar 08 20:07:19.599042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 659/1347] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:19 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:19.988722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9cb3982b-89d9-4fa2-b306-f4e5d8eb076e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:19.989787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9cb3982b-89d9-4fa2-b306-f4e5d8eb076e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:19.997259 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb3982b-89d9-4fa2-b306-f4e5d8eb076e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:19.997833 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb3982b-89d9-4fa2-b306-f4e5d8eb076e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:19.998690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb3982b-89d9-4fa2-b306-f4e5d8eb076e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:19.999444 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9cb3982b-89d9-4fa2-b306-f4e5d8eb076e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:20.031570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9cb3982b-89d9-4fa2-b306-f4e5d8eb076e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Mar 08 20:07:20.032133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 689/1348] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:20.616183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:20.616818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:20.623124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:20.623577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:20.624361 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:20.624799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:20.754559 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:20.765110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-586903a6-4091-42b2-9fb0-a1e22e759d6e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152881 Mar 08 20:07:20.765675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 660/1349] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:20 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:21.043069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-11c720fb-db39-4143-9496-9a52d99b0e57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:21.044014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-11c720fb-db39-4143-9496-9a52d99b0e57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:21.049929 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11c720fb-db39-4143-9496-9a52d99b0e57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:21.050382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11c720fb-db39-4143-9496-9a52d99b0e57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:21.051150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11c720fb-db39-4143-9496-9a52d99b0e57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:21.051580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11c720fb-db39-4143-9496-9a52d99b0e57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:21.081130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-11c720fb-db39-4143-9496-9a52d99b0e57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042153 Mar 08 20:07:21.081681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 690/1350] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:21.782570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:21.783200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:21.790195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:21.790638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:21.791385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:21.791813 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:21.924944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:21.933226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b8ee0ca3-c78c-4086-8264-2eba7787f10b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154497 Mar 08 20:07:21.933788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 661/1351] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:21 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:22.091813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c8052ba3-f4fb-4adb-a378-ceaf45af7f43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:22.092765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c8052ba3-f4fb-4adb-a378-ceaf45af7f43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:22.098926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8052ba3-f4fb-4adb-a378-ceaf45af7f43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:22.099873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8052ba3-f4fb-4adb-a378-ceaf45af7f43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:22.100660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8052ba3-f4fb-4adb-a378-ceaf45af7f43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:22.101099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c8052ba3-f4fb-4adb-a378-ceaf45af7f43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:22.129495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c8052ba3-f4fb-4adb-a378-ceaf45af7f43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041546 Mar 08 20:07:22.130039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 691/1352] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:22.949911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:22.950520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:22.956838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:22.957235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:22.957997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:22.958426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:23.088046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:23.095718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1714503a-bfe1-45ef-8690-fb911e92ef7e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149643 Mar 08 20:07:23.096305 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 662/1353] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:22 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:23.140828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-931c5a3c-07c2-44a2-bad7-0bf5cdd96cf9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:23.141737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-931c5a3c-07c2-44a2-bad7-0bf5cdd96cf9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:23.147883 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-931c5a3c-07c2-44a2-bad7-0bf5cdd96cf9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:23.148367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-931c5a3c-07c2-44a2-bad7-0bf5cdd96cf9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:23.149132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-931c5a3c-07c2-44a2-bad7-0bf5cdd96cf9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:23.149572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-931c5a3c-07c2-44a2-bad7-0bf5cdd96cf9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:23.176958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-931c5a3c-07c2-44a2-bad7-0bf5cdd96cf9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040062 Mar 08 20:07:23.178152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 692/1354] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:23.455376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:07:23.455606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:07:24.113516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:24.113913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:24.120223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:24.120704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:24.121475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:24.121913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:24.188908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a2c987d1-5183-4ef6-b97f-a1420e6500d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:24.189849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a2c987d1-5183-4ef6-b97f-a1420e6500d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:24.196737 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a2c987d1-5183-4ef6-b97f-a1420e6500d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:24.197190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a2c987d1-5183-4ef6-b97f-a1420e6500d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:24.197991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a2c987d1-5183-4ef6-b97f-a1420e6500d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:24.198427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a2c987d1-5183-4ef6-b97f-a1420e6500d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:24.227313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a2c987d1-5183-4ef6-b97f-a1420e6500d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Mar 08 20:07:24.227868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 693/1355] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:07:24.256899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:24.264664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d7ab2474-a852-49c7-b144-69ccfeb2e488 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155210 Mar 08 20:07:24.265227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 663/1356] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:24 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:25.238775 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-535c4016-c1c7-4785-9f22-b11d915da7a2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:25.239659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-535c4016-c1c7-4785-9f22-b11d915da7a2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:25.246471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-535c4016-c1c7-4785-9f22-b11d915da7a2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:25.246921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-535c4016-c1c7-4785-9f22-b11d915da7a2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:25.247690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-535c4016-c1c7-4785-9f22-b11d915da7a2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:25.248130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-535c4016-c1c7-4785-9f22-b11d915da7a2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:25.276121 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-535c4016-c1c7-4785-9f22-b11d915da7a2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041254 Mar 08 20:07:25.276642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 694/1357] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:25.281197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:25.281803 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:25.288060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:25.288540 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:25.289301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:25.289732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:25.418147 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:25.425863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ba416622-c149-4c74-80f2-04b9ca6f5886 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148462 Mar 08 20:07:25.426429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 664/1358] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:25 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:26.288014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c9edec00-b679-4923-a2e8-86dfb05e41f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:26.288936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c9edec00-b679-4923-a2e8-86dfb05e41f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:26.295249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c9edec00-b679-4923-a2e8-86dfb05e41f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:26.295703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c9edec00-b679-4923-a2e8-86dfb05e41f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:26.296504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c9edec00-b679-4923-a2e8-86dfb05e41f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:26.296961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c9edec00-b679-4923-a2e8-86dfb05e41f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:26.325435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c9edec00-b679-4923-a2e8-86dfb05e41f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Mar 08 20:07:26.325977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 695/1359] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:26.443873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:26.444492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:26.450821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:26.451277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:26.452044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:26.452517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:26.585788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:26.593573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fb63b6b9-6695-4c36-a91a-2ff8d28838e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153638 Mar 08 20:07:26.594142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 665/1360] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:26 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:27.336542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-055508ee-f8b5-4e0a-bb94-4704c5ba3c57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:27.337402 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-055508ee-f8b5-4e0a-bb94-4704c5ba3c57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:27.343526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-055508ee-f8b5-4e0a-bb94-4704c5ba3c57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:27.343968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-055508ee-f8b5-4e0a-bb94-4704c5ba3c57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:27.344749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-055508ee-f8b5-4e0a-bb94-4704c5ba3c57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:27.345180 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-055508ee-f8b5-4e0a-bb94-4704c5ba3c57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:27.371842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-055508ee-f8b5-4e0a-bb94-4704c5ba3c57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039885 Mar 08 20:07:27.372394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 696/1361] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:27.611010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:27.611533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:27.618345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:27.618795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:27.619562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:27.620002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:27.750793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:27.759076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c10321fa-719a-469c-8d37-92cc77d9d399 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152082 Mar 08 20:07:27.759903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 666/1362] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:27 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:28.383765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5c463faa-181b-465f-b992-e4d802e68414 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:28.384708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5c463faa-181b-465f-b992-e4d802e68414 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:28.390872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c463faa-181b-465f-b992-e4d802e68414 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:28.391318 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c463faa-181b-465f-b992-e4d802e68414 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:28.392074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c463faa-181b-465f-b992-e4d802e68414 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:28.392534 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5c463faa-181b-465f-b992-e4d802e68414 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:28.420791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5c463faa-181b-465f-b992-e4d802e68414 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 Mar 08 20:07:28.421324 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 697/1363] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:28.776953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:28.777567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:28.784078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:28.784564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:28.785345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:28.785786 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:28.916141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:28.923981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-440a4650-9926-47a7-bd19-5016069e42c1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151267 Mar 08 20:07:28.924587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 667/1364] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:28 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:29.432967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6802ac9f-87e5-4450-ba04-05cfe05e8671 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:29.433791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6802ac9f-87e5-4450-ba04-05cfe05e8671 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:29.440017 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6802ac9f-87e5-4450-ba04-05cfe05e8671 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:29.440502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6802ac9f-87e5-4450-ba04-05cfe05e8671 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:29.441286 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6802ac9f-87e5-4450-ba04-05cfe05e8671 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:29.441708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6802ac9f-87e5-4450-ba04-05cfe05e8671 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:29.468939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6802ac9f-87e5-4450-ba04-05cfe05e8671 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040035 Mar 08 20:07:29.469471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 698/1365] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:29.940346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:29.940956 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:29.947172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:29.947630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:29.948418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:29.948855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:30.080462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:30.088541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7c4afb99-4eb2-414a-898d-bfad7ae5516f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152017 Mar 08 20:07:30.089108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 668/1366] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:29 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:30.480718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-37353a61-0090-44a3-adbb-ff4dd4fd7c88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:30.481611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-37353a61-0090-44a3-adbb-ff4dd4fd7c88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:30.487836 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37353a61-0090-44a3-adbb-ff4dd4fd7c88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:30.488271 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37353a61-0090-44a3-adbb-ff4dd4fd7c88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:30.489068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37353a61-0090-44a3-adbb-ff4dd4fd7c88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:30.489506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-37353a61-0090-44a3-adbb-ff4dd4fd7c88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:30.517321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-37353a61-0090-44a3-adbb-ff4dd4fd7c88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 Mar 08 20:07:30.517868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 699/1367] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:30.769920 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:07:30.770077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:07:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:07:31.105995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:31.106619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:31.113510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:31.113878 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:31.114662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:31.115681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:31.247419 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:31.255181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-de65cc7f-3869-4313-81b3-2d207dc0f0d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153006 Mar 08 20:07:31.255736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 669/1368] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:31 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:31.529544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-011d04e4-f3e6-4387-ab4f-191443024c70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:31.530372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-011d04e4-f3e6-4387-ab4f-191443024c70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:31.537306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-011d04e4-f3e6-4387-ab4f-191443024c70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:31.537756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-011d04e4-f3e6-4387-ab4f-191443024c70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:31.538512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-011d04e4-f3e6-4387-ab4f-191443024c70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:31.538942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-011d04e4-f3e6-4387-ab4f-191443024c70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:31.566163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-011d04e4-f3e6-4387-ab4f-191443024c70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041002 Mar 08 20:07:31.566692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 700/1369] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:32.272051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:32.272626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:32.279228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:32.279685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:32.280507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:32.280946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:32.413906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:32.421845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8e97fcc3-7555-4f53-81d9-2f774d9d3d3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153658 Mar 08 20:07:32.422463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 670/1370] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:32 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:32.577570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-66c7e483-df47-4107-9392-77d3924d6030 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:32.578487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-66c7e483-df47-4107-9392-77d3924d6030 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:32.584760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66c7e483-df47-4107-9392-77d3924d6030 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:32.585209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66c7e483-df47-4107-9392-77d3924d6030 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:32.585972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66c7e483-df47-4107-9392-77d3924d6030 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:32.586412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66c7e483-df47-4107-9392-77d3924d6030 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:32.614186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-66c7e483-df47-4107-9392-77d3924d6030 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040559 Mar 08 20:07:32.615342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 701/1371] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:33.438835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:33.439468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:33.446419 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:33.446895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:33.447668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:33.448105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:33.578634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:33.586326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e090249e-1ebb-4af8-ae1c-18794def8e5a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151430 Mar 08 20:07:33.586893 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 671/1372] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:33 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:33.626261 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b9fa2b97-ccb1-4436-927c-9768c19e7a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:33.627115 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b9fa2b97-ccb1-4436-927c-9768c19e7a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:33.633885 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b97-ccb1-4436-927c-9768c19e7a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:33.634339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b97-ccb1-4436-927c-9768c19e7a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:33.635099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b97-ccb1-4436-927c-9768c19e7a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:33.635538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b97-ccb1-4436-927c-9768c19e7a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:33.663485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b9fa2b97-ccb1-4436-927c-9768c19e7a01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 Mar 08 20:07:33.664062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 702/1373] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:34.603889 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:34.604555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:34.610804 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:34.611260 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:34.612027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:34.612515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:34.674025 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-45c2eea2-f944-45df-a9bc-43f590935dd5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:34.674892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-45c2eea2-f944-45df-a9bc-43f590935dd5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:34.681932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45c2eea2-f944-45df-a9bc-43f590935dd5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:34.682386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45c2eea2-f944-45df-a9bc-43f590935dd5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:34.683163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45c2eea2-f944-45df-a9bc-43f590935dd5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:34.683610 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45c2eea2-f944-45df-a9bc-43f590935dd5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:34.712154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-45c2eea2-f944-45df-a9bc-43f590935dd5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 Mar 08 20:07:34.715892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 703/1374] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:07:34.747365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:34.755193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cea20755-58fb-403c-9931-51ad1b953fb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155140 Mar 08 20:07:34.755755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 672/1375] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:34 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:35.722999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-601bceaf-559f-4cea-b418-56132b829af3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:35.723835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-601bceaf-559f-4cea-b418-56132b829af3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:35.730564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-601bceaf-559f-4cea-b418-56132b829af3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:35.731035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-601bceaf-559f-4cea-b418-56132b829af3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:35.731795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-601bceaf-559f-4cea-b418-56132b829af3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:35.732227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-601bceaf-559f-4cea-b418-56132b829af3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:35.759790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-601bceaf-559f-4cea-b418-56132b829af3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040784 Mar 08 20:07:35.760341 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 704/1376] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:35.772430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:35.773052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:35.779509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:35.779956 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:35.780748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:35.781183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:35.914182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:35.921882 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-20ebfc3e-d0b7-4180-b227-69c9653c2e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153791 Mar 08 20:07:35.922442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 673/1377] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:35 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:36.771150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fffa34e8-2b68-4418-a2ca-edde26c8c2df tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:36.772055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fffa34e8-2b68-4418-a2ca-edde26c8c2df tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:36.778572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fffa34e8-2b68-4418-a2ca-edde26c8c2df tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:36.779023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fffa34e8-2b68-4418-a2ca-edde26c8c2df tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:36.779793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fffa34e8-2b68-4418-a2ca-edde26c8c2df tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:36.780231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fffa34e8-2b68-4418-a2ca-edde26c8c2df tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:36.808034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fffa34e8-2b68-4418-a2ca-edde26c8c2df tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041004 Mar 08 20:07:36.808603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 705/1378] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:36.938964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:36.939578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:36.945536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:36.945992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:36.946757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:36.947196 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:37.077818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:37.085498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ec9e4cd4-676d-4118-ab32-6e6a00e298fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150467 Mar 08 20:07:37.086056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 674/1379] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:36 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:37.819248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ab48917f-25bd-4e47-b968-2ba0f2f333c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:37.820166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ab48917f-25bd-4e47-b968-2ba0f2f333c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:37.826405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab48917f-25bd-4e47-b968-2ba0f2f333c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:37.826872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab48917f-25bd-4e47-b968-2ba0f2f333c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:37.827619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab48917f-25bd-4e47-b968-2ba0f2f333c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:37.828051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab48917f-25bd-4e47-b968-2ba0f2f333c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:37.855927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ab48917f-25bd-4e47-b968-2ba0f2f333c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Mar 08 20:07:37.856505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 706/1380] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:38.102352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:38.102871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:38.109604 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:38.110057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:38.110823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:38.111252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:38.250109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:38.258404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1f6b1e08-bc13-4673-b2cc-1ab1b8874531 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.160039 Mar 08 20:07:38.258972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 675/1381] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:38 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:38.868070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-87c7cfce-ddb3-495e-8011-acaa5f347408 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:38.869013 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-87c7cfce-ddb3-495e-8011-acaa5f347408 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:38.875262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87c7cfce-ddb3-495e-8011-acaa5f347408 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:38.875713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87c7cfce-ddb3-495e-8011-acaa5f347408 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:38.876526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87c7cfce-ddb3-495e-8011-acaa5f347408 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:38.876970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87c7cfce-ddb3-495e-8011-acaa5f347408 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:38.905745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-87c7cfce-ddb3-495e-8011-acaa5f347408 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 Mar 08 20:07:38.906233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 707/1382] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:39.275218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:39.275749 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:39.282028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:39.282473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:39.283236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:39.283668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:39.410729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:39.419022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2f14d55-ea67-44c7-8615-2d57f2f728a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147975 Mar 08 20:07:39.419587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 676/1383] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:39 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:39.917489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c17ac5d9-ec9c-4298-8f2e-96528e6a98b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:39.918354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c17ac5d9-ec9c-4298-8f2e-96528e6a98b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:39.924579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c17ac5d9-ec9c-4298-8f2e-96528e6a98b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:39.925034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c17ac5d9-ec9c-4298-8f2e-96528e6a98b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:39.925803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c17ac5d9-ec9c-4298-8f2e-96528e6a98b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:39.926245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c17ac5d9-ec9c-4298-8f2e-96528e6a98b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:39.955310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c17ac5d9-ec9c-4298-8f2e-96528e6a98b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041481 Mar 08 20:07:39.956307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 708/1384] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:40.436583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:40.437199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:40.443446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:40.443897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:40.444699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:40.445139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:40.578176 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:40.586421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-693591ed-f44b-4760-9f53-5809fd1395fe tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153835 Mar 08 20:07:40.586979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 677/1385] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:40 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:40.967088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0121e42f-96a6-46d2-947c-decb1698134a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:40.967934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0121e42f-96a6-46d2-947c-decb1698134a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:40.974709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0121e42f-96a6-46d2-947c-decb1698134a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:40.975158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0121e42f-96a6-46d2-947c-decb1698134a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:40.975924 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0121e42f-96a6-46d2-947c-decb1698134a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:40.976387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0121e42f-96a6-46d2-947c-decb1698134a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:41.005497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0121e42f-96a6-46d2-947c-decb1698134a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042254 Mar 08 20:07:41.006058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 709/1386] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:41.603416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:41.604104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:41.610332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:41.610778 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:41.611549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:41.611986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:41.741484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:41.749823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a6ee2882-635f-4688-a434-eb90ef6668a2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150717 Mar 08 20:07:41.750396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 678/1387] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:41 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:42.016139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4a4a9bae-1a5c-4ae4-9302-497dadd8d131 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:42.017134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4a4a9bae-1a5c-4ae4-9302-497dadd8d131 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:42.023358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a4a9bae-1a5c-4ae4-9302-497dadd8d131 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:42.023813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a4a9bae-1a5c-4ae4-9302-497dadd8d131 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:42.024621 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a4a9bae-1a5c-4ae4-9302-497dadd8d131 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:42.025327 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a4a9bae-1a5c-4ae4-9302-497dadd8d131 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:42.052926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4a4a9bae-1a5c-4ae4-9302-497dadd8d131 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040895 Mar 08 20:07:42.053473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 710/1388] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:42.766638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:42.767273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:42.773483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:42.773935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:42.774957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:42.775404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:42.905614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:42.913769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6f399f5a-75f7-4726-aeb3-48f93b589aad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150978 Mar 08 20:07:42.914324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 679/1389] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:42 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:43.064426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-11f7b525-464e-4407-8e8b-43a5abdbc905 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:43.065337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-11f7b525-464e-4407-8e8b-43a5abdbc905 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:43.071526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11f7b525-464e-4407-8e8b-43a5abdbc905 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:43.071975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11f7b525-464e-4407-8e8b-43a5abdbc905 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:43.072762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11f7b525-464e-4407-8e8b-43a5abdbc905 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:43.073198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-11f7b525-464e-4407-8e8b-43a5abdbc905 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:43.102141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-11f7b525-464e-4407-8e8b-43a5abdbc905 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041640 Mar 08 20:07:43.102613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 711/1390] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:43.930757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:43.931380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:43.937656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:43.938111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:43.938881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:43.939320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:44.071005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:44.078780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e111bf39-3933-43b7-9f18-388c5c337946 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152384 Mar 08 20:07:44.079346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 680/1391] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:43 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:44.113557 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bdb03d82-e823-4c58-bc96-d71dde26373a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:44.114524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bdb03d82-e823-4c58-bc96-d71dde26373a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:44.121064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdb03d82-e823-4c58-bc96-d71dde26373a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:44.121527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdb03d82-e823-4c58-bc96-d71dde26373a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:44.122303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdb03d82-e823-4c58-bc96-d71dde26373a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:44.122742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bdb03d82-e823-4c58-bc96-d71dde26373a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:44.158360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bdb03d82-e823-4c58-bc96-d71dde26373a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048698 Mar 08 20:07:44.158941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 712/1392] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:44.535522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:07:44.535769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:07:45.096681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:45.097289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:45.104034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:45.104521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:45.105282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:45.105730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:45.170458 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-655dee20-a2ba-4385-abd1-8497603e08c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:45.171373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-655dee20-a2ba-4385-abd1-8497603e08c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:45.178145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-655dee20-a2ba-4385-abd1-8497603e08c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:45.178591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-655dee20-a2ba-4385-abd1-8497603e08c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:45.179358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-655dee20-a2ba-4385-abd1-8497603e08c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:45.179794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-655dee20-a2ba-4385-abd1-8497603e08c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:45.210299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-655dee20-a2ba-4385-abd1-8497603e08c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Mar 08 20:07:45.210850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 713/1393] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:07:45.236523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:45.244888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f0e833f1-4a7d-42d7-9d97-d1f89b28fb00 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152029 Mar 08 20:07:45.245452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 681/1394] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:45 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:46.222341 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a5a2d702-a2e4-4fd7-a19d-7231a0cec439 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:46.223919 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a5a2d702-a2e4-4fd7-a19d-7231a0cec439 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:46.231290 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5a2d702-a2e4-4fd7-a19d-7231a0cec439 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:46.231756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5a2d702-a2e4-4fd7-a19d-7231a0cec439 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:46.232553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5a2d702-a2e4-4fd7-a19d-7231a0cec439 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:46.232989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a5a2d702-a2e4-4fd7-a19d-7231a0cec439 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:46.261358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a5a2d702-a2e4-4fd7-a19d-7231a0cec439 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Mar 08 20:07:46.261911 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 714/1395] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:46.262024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:46.262590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:46.268907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:46.269358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:46.270121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:46.270621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:46.402207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:46.409856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3dd9de83-d630-4873-823a-fd6fb4e15841 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151704 Mar 08 20:07:46.410445 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 682/1396] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:46 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:07:47.272457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7c6905fb-84fe-499b-b947-06931fa502d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:47.273284 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7c6905fb-84fe-499b-b947-06931fa502d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:47.279648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c6905fb-84fe-499b-b947-06931fa502d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:47.280091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c6905fb-84fe-499b-b947-06931fa502d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:47.280877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c6905fb-84fe-499b-b947-06931fa502d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:47.281306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7c6905fb-84fe-499b-b947-06931fa502d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:47.308773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7c6905fb-84fe-499b-b947-06931fa502d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040332 Mar 08 20:07:47.309355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 715/1397] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:47.426637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:47.427815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:47.434163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:47.434614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:47.435383 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:47.435820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:47.562889 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:47.571156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5a1949c8-7c36-4e07-9a33-0a8b35478525 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148387 Mar 08 20:07:47.571715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 683/1398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:47 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:48.320225 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9c99c254-6a22-454c-8f2a-2527f2bf8343 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:48.321153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9c99c254-6a22-454c-8f2a-2527f2bf8343 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:48.327305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c99c254-6a22-454c-8f2a-2527f2bf8343 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:48.327744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c99c254-6a22-454c-8f2a-2527f2bf8343 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:48.328532 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c99c254-6a22-454c-8f2a-2527f2bf8343 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:48.328958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9c99c254-6a22-454c-8f2a-2527f2bf8343 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:48.357115 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9c99c254-6a22-454c-8f2a-2527f2bf8343 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040861 Mar 08 20:07:48.357650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 716/1399] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:48.588381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:48.588923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:48.595250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:48.595709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:48.596513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:48.596954 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:48.729252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:48.736831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-acc7a24f-b59f-4212-855f-5a64c94974a4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152502 Mar 08 20:07:48.737380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 684/1400] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:48 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:49.368604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-09c37be6-ddab-4167-940d-82e6628e83fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:49.370409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-09c37be6-ddab-4167-940d-82e6628e83fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:49.381032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09c37be6-ddab-4167-940d-82e6628e83fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:49.381479 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09c37be6-ddab-4167-940d-82e6628e83fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:49.382247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09c37be6-ddab-4167-940d-82e6628e83fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:49.382676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09c37be6-ddab-4167-940d-82e6628e83fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:49.410505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-09c37be6-ddab-4167-940d-82e6628e83fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045986 Mar 08 20:07:49.411638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 717/1401] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:49.754024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:49.754608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:49.760802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:49.761242 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:49.761999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:49.762428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:49.892130 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:49.900083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e82836bd-6391-48bf-bffc-63fffb5cf7d9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150069 Mar 08 20:07:49.900678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 685/1402] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:49 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:50.422160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d59c3fb5-f796-4169-9518-e6daf511b8f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:50.422990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d59c3fb5-f796-4169-9518-e6daf511b8f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:50.429526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d59c3fb5-f796-4169-9518-e6daf511b8f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:50.429970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d59c3fb5-f796-4169-9518-e6daf511b8f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:50.430751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d59c3fb5-f796-4169-9518-e6daf511b8f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:50.431187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d59c3fb5-f796-4169-9518-e6daf511b8f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:50.458102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d59c3fb5-f796-4169-9518-e6daf511b8f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040110 Mar 08 20:07:50.458625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 718/1403] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:50.917625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:50.918236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:50.924516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:50.924969 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:50.925737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:50.926176 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:51.052125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:51.059854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8bb65a07-1a2f-4d6f-b3de-e4f7afdb6fc3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.146119 Mar 08 20:07:51.060432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 686/1404] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:50 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:51.469425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f3c76930-f93f-4f42-9342-ef805458235d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:51.470327 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f3c76930-f93f-4f42-9342-ef805458235d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:51.477156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3c76930-f93f-4f42-9342-ef805458235d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:51.477610 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3c76930-f93f-4f42-9342-ef805458235d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:51.478377 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3c76930-f93f-4f42-9342-ef805458235d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:51.478820 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3c76930-f93f-4f42-9342-ef805458235d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:51.507288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f3c76930-f93f-4f42-9342-ef805458235d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041792 Mar 08 20:07:51.507850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 719/1405] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:52.228174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:52.228860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:52.234685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:52.235142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:52.235913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:52.236382 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:52.466800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:52.475078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6e0b7960-047c-4891-9d66-e46768891c55 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.402174 Mar 08 20:07:52.475642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 687/1406] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:52 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:52.635187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ed5e4c61-b647-4905-b27d-33c73654b853 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:52.636156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ed5e4c61-b647-4905-b27d-33c73654b853 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:52.641939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed5e4c61-b647-4905-b27d-33c73654b853 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:52.642395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed5e4c61-b647-4905-b27d-33c73654b853 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:52.643158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed5e4c61-b647-4905-b27d-33c73654b853 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:52.643595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed5e4c61-b647-4905-b27d-33c73654b853 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:52.672656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ed5e4c61-b647-4905-b27d-33c73654b853 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157571 Mar 08 20:07:52.673205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 720/1407] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:53.491418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:53.492036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:53.498310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:53.498766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:53.499568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:53.500010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:53.630219 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:53.638127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-59f00ae9-1bc1-4ded-af75-e607753aedd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151144 Mar 08 20:07:53.638689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 688/1408] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:53 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:53.684930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7cd1f6a3-1832-4eaa-8221-a9813896931e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:53.685838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7cd1f6a3-1832-4eaa-8221-a9813896931e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:53.691992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7cd1f6a3-1832-4eaa-8221-a9813896931e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:53.692480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7cd1f6a3-1832-4eaa-8221-a9813896931e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:53.693243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7cd1f6a3-1832-4eaa-8221-a9813896931e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:53.693677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7cd1f6a3-1832-4eaa-8221-a9813896931e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:53.720859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7cd1f6a3-1832-4eaa-8221-a9813896931e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039699 Mar 08 20:07:53.721347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 721/1409] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:54.655229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:54.655784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:54.662041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:54.662496 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:54.663261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:54.663704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:54.733098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-48cac0fc-f197-42dd-88b5-35d744387048 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:54.734004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-48cac0fc-f197-42dd-88b5-35d744387048 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:54.740740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48cac0fc-f197-42dd-88b5-35d744387048 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:54.741186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48cac0fc-f197-42dd-88b5-35d744387048 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:54.741948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48cac0fc-f197-42dd-88b5-35d744387048 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:54.742380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48cac0fc-f197-42dd-88b5-35d744387048 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:54.770716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-48cac0fc-f197-42dd-88b5-35d744387048 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041541 Mar 08 20:07:54.771542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 722/1410] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:07:54.795989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:54.804243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c30f55bc-2cf1-4d5e-8a0a-4cd7778d3d95 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152930 Mar 08 20:07:54.804826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 689/1411] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:54 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:55.781563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-20491e85-2e7d-40af-91ce-8c6186e025da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:55.782433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-20491e85-2e7d-40af-91ce-8c6186e025da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:55.788928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20491e85-2e7d-40af-91ce-8c6186e025da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:55.789406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20491e85-2e7d-40af-91ce-8c6186e025da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:55.790175 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20491e85-2e7d-40af-91ce-8c6186e025da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:55.790614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20491e85-2e7d-40af-91ce-8c6186e025da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:55.818464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-20491e85-2e7d-40af-91ce-8c6186e025da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040879 Mar 08 20:07:55.819011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 723/1412] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:55.821502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:55.822121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:55.828264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:55.828740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:55.829527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:55.829961 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:55.956227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:55.964521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3705c9a4-94fa-4223-b190-588cbbd62710 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147267 Mar 08 20:07:55.965080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 690/1413] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:55 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:07:56.829884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6855d7c5-1e40-4aa5-b852-d55de3f98c0d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:56.830803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6855d7c5-1e40-4aa5-b852-d55de3f98c0d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:56.837118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6855d7c5-1e40-4aa5-b852-d55de3f98c0d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:56.837562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6855d7c5-1e40-4aa5-b852-d55de3f98c0d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:56.838323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6855d7c5-1e40-4aa5-b852-d55de3f98c0d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:56.838759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6855d7c5-1e40-4aa5-b852-d55de3f98c0d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:56.866618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6855d7c5-1e40-4aa5-b852-d55de3f98c0d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040647 Mar 08 20:07:56.867149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 724/1414] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:56.986775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:56.987385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:56.994201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:56.994653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:56.995421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:56.995864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:57.124649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:57.133628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3002a52b-3273-46a0-86fd-964b8e8ffa8a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150647 Mar 08 20:07:57.134209 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 691/1415] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:56 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:57.877856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-710cf55a-5aa8-453f-baa6-187290e3cb56 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:57.878772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-710cf55a-5aa8-453f-baa6-187290e3cb56 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:57.885498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-710cf55a-5aa8-453f-baa6-187290e3cb56 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:57.885945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-710cf55a-5aa8-453f-baa6-187290e3cb56 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:57.886705 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-710cf55a-5aa8-453f-baa6-187290e3cb56 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:57.887138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-710cf55a-5aa8-453f-baa6-187290e3cb56 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:57.915112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-710cf55a-5aa8-453f-baa6-187290e3cb56 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041148 Mar 08 20:07:57.915644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 725/1416] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:58.152906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:58.153521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:58.159911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:58.160388 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:58.161162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:58.161603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:58.294122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:58.302306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2253b63c-d196-4921-acb8-9e8ed54a4df4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153551 Mar 08 20:07:58.302864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 692/1417] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:58 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:58.927020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-947996d1-8ac5-46f5-b288-387b8bd11522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:58.927959 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-947996d1-8ac5-46f5-b288-387b8bd11522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:58.934137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-947996d1-8ac5-46f5-b288-387b8bd11522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:58.934584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-947996d1-8ac5-46f5-b288-387b8bd11522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:58.935344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-947996d1-8ac5-46f5-b288-387b8bd11522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:58.935777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-947996d1-8ac5-46f5-b288-387b8bd11522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:58.963059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-947996d1-8ac5-46f5-b288-387b8bd11522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 Mar 08 20:07:58.963539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 726/1418] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:07:59.318925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:59.319541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:59.325916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:59.326370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:59.327139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:59.327581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:59.455387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:07:59.463690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2f01a37-7df3-4a82-b4cf-1522df4729e4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148613 Mar 08 20:07:59.464381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 693/1419] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:07:59 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:07:59.974525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-94112731-abca-46da-bad8-d2b2bc2fca28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:07:59.975363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-94112731-abca-46da-bad8-d2b2bc2fca28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:07:59.981736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94112731-abca-46da-bad8-d2b2bc2fca28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:59.982192 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94112731-abca-46da-bad8-d2b2bc2fca28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:07:59.982955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94112731-abca-46da-bad8-d2b2bc2fca28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:07:59.983393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-94112731-abca-46da-bad8-d2b2bc2fca28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:00.012358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-94112731-abca-46da-bad8-d2b2bc2fca28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 Mar 08 20:08:00.012907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 727/1420] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:07:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:00.480137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:00.480774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:00.487018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:00.487468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:00.488239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:00.488687 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:00.620815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:00.628479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ebb14357-7470-4ca8-bb29-70fce724b9c7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152173 Mar 08 20:08:00.629029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 694/1421] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:00 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:01.023607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0a696da1-c371-4ff9-b215-325efec77575 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:01.024752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0a696da1-c371-4ff9-b215-325efec77575 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:01.030937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a696da1-c371-4ff9-b215-325efec77575 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:01.031389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a696da1-c371-4ff9-b215-325efec77575 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:01.032159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a696da1-c371-4ff9-b215-325efec77575 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:01.032631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a696da1-c371-4ff9-b215-325efec77575 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:01.061427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0a696da1-c371-4ff9-b215-325efec77575 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041760 Mar 08 20:08:01.061974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 728/1422] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:01.645328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:01.645915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:01.652531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:01.652981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:01.653746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:01.654182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:01.781729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:01.789431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cacb5114-b3f3-42d6-9a28-fe9ada37416d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148040 Mar 08 20:08:01.789990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 695/1423] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:01 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:02.073317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-487b7523-e103-46cb-9b24-574cecc017ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:02.074234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-487b7523-e103-46cb-9b24-574cecc017ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:02.080538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-487b7523-e103-46cb-9b24-574cecc017ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:02.080994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-487b7523-e103-46cb-9b24-574cecc017ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:02.081762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-487b7523-e103-46cb-9b24-574cecc017ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:02.082204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-487b7523-e103-46cb-9b24-574cecc017ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:02.109327 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-487b7523-e103-46cb-9b24-574cecc017ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039912 Mar 08 20:08:02.109877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 729/1424] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:02.806122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:02.806735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:02.813107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:02.813568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:02.814363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:02.814798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:02.948600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:02.956857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-798dc2ff-805f-493e-96df-f22a753c9caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.154602 Mar 08 20:08:02.958009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 696/1425] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:02 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:08:03.120803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-704fd6f5-f81a-4e05-b5ef-e412c61ae51e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:03.121743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-704fd6f5-f81a-4e05-b5ef-e412c61ae51e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:03.127941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-704fd6f5-f81a-4e05-b5ef-e412c61ae51e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:03.128502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-704fd6f5-f81a-4e05-b5ef-e412c61ae51e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:03.129764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-704fd6f5-f81a-4e05-b5ef-e412c61ae51e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:03.130210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-704fd6f5-f81a-4e05-b5ef-e412c61ae51e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:03.158333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-704fd6f5-f81a-4e05-b5ef-e412c61ae51e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041505 Mar 08 20:08:03.158868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 730/1426] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:03.974459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:03.975062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:03.981393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:03.981842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:03.982616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:03.983054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:04.114861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:04.122852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9c7ff6dd-59cc-4243-998b-5225c2fa38b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152200 Mar 08 20:08:04.123415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 697/1427] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:03 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:04.169550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-19043296-c231-485c-a1a8-e56a6c469c00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:04.170464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-19043296-c231-485c-a1a8-e56a6c469c00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:04.176688 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19043296-c231-485c-a1a8-e56a6c469c00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:04.177140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19043296-c231-485c-a1a8-e56a6c469c00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:04.177905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19043296-c231-485c-a1a8-e56a6c469c00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:04.178342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19043296-c231-485c-a1a8-e56a6c469c00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:04.206220 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-19043296-c231-485c-a1a8-e56a6c469c00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040564 Mar 08 20:08:04.206762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 731/1428] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:05.139963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:05.140620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:05.146848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:05.147305 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:05.148068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:05.148536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:05.218170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-083c3a5f-59de-42aa-88ef-a85541ee06a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:05.219083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-083c3a5f-59de-42aa-88ef-a85541ee06a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:05.225248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-083c3a5f-59de-42aa-88ef-a85541ee06a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:05.225692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-083c3a5f-59de-42aa-88ef-a85541ee06a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:05.226452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-083c3a5f-59de-42aa-88ef-a85541ee06a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:05.226880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-083c3a5f-59de-42aa-88ef-a85541ee06a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:05.259894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-083c3a5f-59de-42aa-88ef-a85541ee06a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045570 Mar 08 20:08:05.260708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 732/1429] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:08:05.281857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:05.289537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2154d8e0-4cc9-4583-91fe-9c2781c7bf43 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153542 Mar 08 20:08:05.290088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 698/1430] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:05 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:06.271151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-79f47eac-72ba-4df2-baba-461e718b09c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:06.272062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-79f47eac-72ba-4df2-baba-461e718b09c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:06.278560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f47eac-72ba-4df2-baba-461e718b09c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:06.279014 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f47eac-72ba-4df2-baba-461e718b09c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:06.279805 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f47eac-72ba-4df2-baba-461e718b09c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:06.280244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f47eac-72ba-4df2-baba-461e718b09c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:06.306023 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:06.306627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:06.309113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-79f47eac-72ba-4df2-baba-461e718b09c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041906 Mar 08 20:08:06.310336 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 733/1431] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:06.313025 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:06.313474 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:06.314257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:06.314690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:06.445019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:06.452691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ab19956a-b307-4d45-a6fe-dc80f56e64a1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150996 Mar 08 20:08:06.453254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 699/1432] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:06 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:08:07.320312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-abae0561-dd05-4401-a00b-e22c6340067d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:07.321234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-abae0561-dd05-4401-a00b-e22c6340067d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:07.327420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abae0561-dd05-4401-a00b-e22c6340067d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:07.327876 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abae0561-dd05-4401-a00b-e22c6340067d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:07.328720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abae0561-dd05-4401-a00b-e22c6340067d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:07.329161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abae0561-dd05-4401-a00b-e22c6340067d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:07.358244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-abae0561-dd05-4401-a00b-e22c6340067d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Mar 08 20:08:07.358791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 734/1433] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:07.470318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:07.470843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:07.477407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:07.477858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:07.478628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:07.479063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:07.605535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:07.613339 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fccb303b-804b-4362-abcd-e19e1ba6d1d8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.146998 Mar 08 20:08:07.613939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 700/1434] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:07 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:08.370156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-19ff6b26-b81c-48ec-b03d-fed9984e036a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:08.371002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-19ff6b26-b81c-48ec-b03d-fed9984e036a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:08.377284 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19ff6b26-b81c-48ec-b03d-fed9984e036a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:08.377743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19ff6b26-b81c-48ec-b03d-fed9984e036a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:08.378521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19ff6b26-b81c-48ec-b03d-fed9984e036a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:08.378969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19ff6b26-b81c-48ec-b03d-fed9984e036a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:08.406521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-19ff6b26-b81c-48ec-b03d-fed9984e036a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040981 Mar 08 20:08:08.407057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 735/1435] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:08.630678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:08.631207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:08.637539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:08.637988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:08.638747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:08.639182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:08.771037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:08.779529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1850e144-f7b9-4038-865b-f9b02eb8b836 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152809 Mar 08 20:08:08.780090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 701/1436] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:08 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:09.417770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-56da254c-eeec-4aa4-9bde-6faf2e56cec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:09.418683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-56da254c-eeec-4aa4-9bde-6faf2e56cec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:09.424933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56da254c-eeec-4aa4-9bde-6faf2e56cec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:09.425383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56da254c-eeec-4aa4-9bde-6faf2e56cec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:09.426176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56da254c-eeec-4aa4-9bde-6faf2e56cec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:09.426609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-56da254c-eeec-4aa4-9bde-6faf2e56cec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:09.454810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-56da254c-eeec-4aa4-9bde-6faf2e56cec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040992 Mar 08 20:08:09.455344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 736/1437] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:09.797241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:09.797768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:09.804444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:09.804891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:09.805646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:09.806082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:09.932785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:09.940346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-060d243c-7ffc-47ea-9678-8476b3762f07 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147046 Mar 08 20:08:09.940906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 702/1438] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:09 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:10.466996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e42944ed-8ab5-4b62-83cf-c778556001e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:10.467908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e42944ed-8ab5-4b62-83cf-c778556001e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:10.474214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42944ed-8ab5-4b62-83cf-c778556001e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:10.474664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42944ed-8ab5-4b62-83cf-c778556001e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:10.475431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42944ed-8ab5-4b62-83cf-c778556001e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:10.476470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42944ed-8ab5-4b62-83cf-c778556001e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:10.503706 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e42944ed-8ab5-4b62-83cf-c778556001e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040603 Mar 08 20:08:10.504254 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 737/1439] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:10.957124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:10.957731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:10.964020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:10.964504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:10.965272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:10.965709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:11.093668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:11.101355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e5a50abc-c416-4d9c-893c-ea389db5ac8b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.148083 Mar 08 20:08:11.101918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 703/1440] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:10 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:11.515457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c1a5b51b-8e01-43fa-8a7d-03372a15f555 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:11.516400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c1a5b51b-8e01-43fa-8a7d-03372a15f555 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:11.525165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a5b51b-8e01-43fa-8a7d-03372a15f555 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:11.525780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a5b51b-8e01-43fa-8a7d-03372a15f555 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:11.526545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a5b51b-8e01-43fa-8a7d-03372a15f555 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:11.527011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c1a5b51b-8e01-43fa-8a7d-03372a15f555 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:11.554648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c1a5b51b-8e01-43fa-8a7d-03372a15f555 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Mar 08 20:08:11.555192 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 738/1441] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:12.118136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:12.118757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:12.125045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:12.125498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:12.126271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:12.126713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:12.257069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:12.264798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-673cd29c-f919-46a7-bcea-ca19e62344ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151153 Mar 08 20:08:12.265358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 704/1442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:12 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:12.566054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2d52c92d-753a-48d2-ac7e-e28bc24582c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:12.566976 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2d52c92d-753a-48d2-ac7e-e28bc24582c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:12.573186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d52c92d-753a-48d2-ac7e-e28bc24582c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:12.573639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d52c92d-753a-48d2-ac7e-e28bc24582c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:12.574405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d52c92d-753a-48d2-ac7e-e28bc24582c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:12.574840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2d52c92d-753a-48d2-ac7e-e28bc24582c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:12.603722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2d52c92d-753a-48d2-ac7e-e28bc24582c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Mar 08 20:08:12.604277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 739/1443] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:13.286121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:13.286727 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:13.293596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:13.294038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:13.294824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:13.295247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:13.425083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:13.433409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e47e9b87-bdcd-416c-b574-69004b8799ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151202 Mar 08 20:08:13.433973 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 705/1444] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:13 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:13.615734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9efbfb1c-c37a-41b7-8c42-7717a4034c81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:13.616775 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9efbfb1c-c37a-41b7-8c42-7717a4034c81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:13.624989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9efbfb1c-c37a-41b7-8c42-7717a4034c81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:13.625441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9efbfb1c-c37a-41b7-8c42-7717a4034c81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:13.626218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9efbfb1c-c37a-41b7-8c42-7717a4034c81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:13.627018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9efbfb1c-c37a-41b7-8c42-7717a4034c81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:13.657610 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9efbfb1c-c37a-41b7-8c42-7717a4034c81 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Mar 08 20:08:13.658165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 740/1445] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:14.450623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:14.451214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:14.457559 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:14.458039 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:14.458807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:14.459252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:14.590246 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:14.597980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-56012317-5848-40ec-8ed6-32f4cd3ef3b0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151807 Mar 08 20:08:14.598552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 706/1446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:14 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:14.668922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8b6ee78b-7fcc-4b0c-ab89-bd355a635797 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:14.669740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8b6ee78b-7fcc-4b0c-ab89-bd355a635797 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:14.676332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b6ee78b-7fcc-4b0c-ab89-bd355a635797 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:14.676772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b6ee78b-7fcc-4b0c-ab89-bd355a635797 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:14.677548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b6ee78b-7fcc-4b0c-ab89-bd355a635797 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:14.677991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b6ee78b-7fcc-4b0c-ab89-bd355a635797 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:14.708978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8b6ee78b-7fcc-4b0c-ab89-bd355a635797 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Mar 08 20:08:14.709524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 741/1447] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:15.614839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:15.615453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:15.621741 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:15.622190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:15.622957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:15.623386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:15.720814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5341ecb1-3263-4a97-a243-0b6a08b57ed8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:15.721723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5341ecb1-3263-4a97-a243-0b6a08b57ed8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:15.728649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5341ecb1-3263-4a97-a243-0b6a08b57ed8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:15.729094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5341ecb1-3263-4a97-a243-0b6a08b57ed8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:15.729860 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5341ecb1-3263-4a97-a243-0b6a08b57ed8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:15.730291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5341ecb1-3263-4a97-a243-0b6a08b57ed8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:15.755972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:15.764171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0f2c0422-95e3-48e1-b484-a6e462b12b12 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153225 Mar 08 20:08:15.764969 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 707/1448] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:15 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:15.768182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5341ecb1-3263-4a97-a243-0b6a08b57ed8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051113 Mar 08 20:08:15.771803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 742/1449] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:16.779809 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ee880c22-8c34-499e-ad5c-1557da4788b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:16.780811 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ee880c22-8c34-499e-ad5c-1557da4788b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:16.781769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:16.782528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:16.788493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee880c22-8c34-499e-ad5c-1557da4788b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:16.788938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee880c22-8c34-499e-ad5c-1557da4788b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:16.789070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:16.789501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:16.789700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee880c22-8c34-499e-ad5c-1557da4788b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:16.790164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee880c22-8c34-499e-ad5c-1557da4788b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:16.790618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:16.791067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:16.819696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ee880c22-8c34-499e-ad5c-1557da4788b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Mar 08 20:08:16.820488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 708/1450] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:16.978306 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:16.986078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7a6ff049-81ae-444b-a424-c84bfa74850f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.208209 Mar 08 20:08:16.986593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 743/1451] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:16 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:17.831483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e1d11647-769b-45cf-b454-e686f8461954 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:17.832422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e1d11647-769b-45cf-b454-e686f8461954 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:17.838655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1d11647-769b-45cf-b454-e686f8461954 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:17.839110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1d11647-769b-45cf-b454-e686f8461954 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:17.839884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1d11647-769b-45cf-b454-e686f8461954 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:17.840418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e1d11647-769b-45cf-b454-e686f8461954 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:17.874895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e1d11647-769b-45cf-b454-e686f8461954 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041003 Mar 08 20:08:17.874895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 709/1452] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:18.003395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:18.004000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:18.010202 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:18.010653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:18.011415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:18.011850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:18.142918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:18.151034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-97c4741a-6353-4167-b3d4-acff44590011 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151523 Mar 08 20:08:18.151599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 744/1453] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:17 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:18.880898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9ef680bf-cd8e-41e7-89a6-6f99d2338f38 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:18.882042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9ef680bf-cd8e-41e7-89a6-6f99d2338f38 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:18.888945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ef680bf-cd8e-41e7-89a6-6f99d2338f38 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:18.889399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ef680bf-cd8e-41e7-89a6-6f99d2338f38 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:18.890169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ef680bf-cd8e-41e7-89a6-6f99d2338f38 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:18.890604 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ef680bf-cd8e-41e7-89a6-6f99d2338f38 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:18.919792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9ef680bf-cd8e-41e7-89a6-6f99d2338f38 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Mar 08 20:08:18.920557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 710/1454] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:19.167782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:19.168412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:19.174808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:19.175256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:19.176018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:19.176482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:19.308301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:19.315971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-da090351-78fa-46d0-9702-e09754437ecc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152072 Mar 08 20:08:19.316581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 745/1455] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:19 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:19.931534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-01eb86cb-bd55-4076-91a3-f0141efa2725 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:19.932482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-01eb86cb-bd55-4076-91a3-f0141efa2725 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:19.938705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01eb86cb-bd55-4076-91a3-f0141efa2725 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:19.939154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01eb86cb-bd55-4076-91a3-f0141efa2725 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:19.939922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01eb86cb-bd55-4076-91a3-f0141efa2725 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:19.940392 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-01eb86cb-bd55-4076-91a3-f0141efa2725 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:19.968961 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-01eb86cb-bd55-4076-91a3-f0141efa2725 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041860 Mar 08 20:08:19.969511 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 711/1456] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:20.333826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:20.334434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:20.340859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:20.341305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:20.342068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:20.342500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:20.469900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:20.477595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f2fd7e1a-a98a-416a-8665-ef7f119086c2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147847 Mar 08 20:08:20.478157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 746/1457] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:20 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:20.980775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6e9e1d0b-f24e-4a92-9ee9-ac1bfaac0da2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:20.981656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6e9e1d0b-f24e-4a92-9ee9-ac1bfaac0da2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:20.987921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e9e1d0b-f24e-4a92-9ee9-ac1bfaac0da2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:20.988405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e9e1d0b-f24e-4a92-9ee9-ac1bfaac0da2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:20.989183 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e9e1d0b-f24e-4a92-9ee9-ac1bfaac0da2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:20.989621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6e9e1d0b-f24e-4a92-9ee9-ac1bfaac0da2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:21.017836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6e9e1d0b-f24e-4a92-9ee9-ac1bfaac0da2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Mar 08 20:08:21.018394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 712/1458] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:21.495134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:21.495724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:21.502100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:21.502551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:21.503320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:21.503759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:21.638792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:21.646476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fb40349c-689e-4e4a-a62f-a1018568d2e0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155719 Mar 08 20:08:21.647044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 747/1459] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:21 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:22.029612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-044443ae-3f61-4b3a-95ab-bb8f584c137e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:22.030551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-044443ae-3f61-4b3a-95ab-bb8f584c137e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:22.036793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-044443ae-3f61-4b3a-95ab-bb8f584c137e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:22.037236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-044443ae-3f61-4b3a-95ab-bb8f584c137e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:22.037995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-044443ae-3f61-4b3a-95ab-bb8f584c137e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:22.038424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-044443ae-3f61-4b3a-95ab-bb8f584c137e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:22.068997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-044443ae-3f61-4b3a-95ab-bb8f584c137e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043271 Mar 08 20:08:22.069555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 713/1460] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:22.664031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:22.664643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:22.670914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:22.671364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:22.672126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:22.672590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:22.805648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:22.813321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d8687f63-e20c-4425-8006-3b705efa30d3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153147 Mar 08 20:08:22.813882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 748/1461] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:22 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:23.082506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7d49437a-25a1-471e-bd63-2c6b8cd952b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:23.083423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7d49437a-25a1-471e-bd63-2c6b8cd952b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:23.091602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d49437a-25a1-471e-bd63-2c6b8cd952b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:23.092053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d49437a-25a1-471e-bd63-2c6b8cd952b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:23.092854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d49437a-25a1-471e-bd63-2c6b8cd952b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:23.093294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d49437a-25a1-471e-bd63-2c6b8cd952b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:23.121821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7d49437a-25a1-471e-bd63-2c6b8cd952b4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Mar 08 20:08:23.122385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 714/1462] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:23.830769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:23.831384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:23.838232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:23.838683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:23.839449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:23.839887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:23.969626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:23.977414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-17dcb234-8a08-499a-a4ea-10679601e044 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150380 Mar 08 20:08:23.978485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 749/1463] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:23 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:24.133360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d8aaf056-463c-4314-b667-5a8ebbb87693 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:24.134790 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d8aaf056-463c-4314-b667-5a8ebbb87693 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:24.141057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8aaf056-463c-4314-b667-5a8ebbb87693 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:24.141510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8aaf056-463c-4314-b667-5a8ebbb87693 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:24.142274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8aaf056-463c-4314-b667-5a8ebbb87693 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:24.142712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8aaf056-463c-4314-b667-5a8ebbb87693 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:24.170763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d8aaf056-463c-4314-b667-5a8ebbb87693 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041341 Mar 08 20:08:24.171306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 715/1464] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:24.994690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:24.995311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:25.001606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:25.002051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:25.002800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:25.003227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:25.134397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:25.142067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6f805463-cd58-4fc3-aa65-dec7c1579098 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.151263 Mar 08 20:08:25.142634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 750/1465] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:24 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:25.182206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1476cebc-3bd7-4615-b8cd-4d1800595c89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:25.183119 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1476cebc-3bd7-4615-b8cd-4d1800595c89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:25.189425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1476cebc-3bd7-4615-b8cd-4d1800595c89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:25.189876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1476cebc-3bd7-4615-b8cd-4d1800595c89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:25.190644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1476cebc-3bd7-4615-b8cd-4d1800595c89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:25.191081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1476cebc-3bd7-4615-b8cd-4d1800595c89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:25.220224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1476cebc-3bd7-4615-b8cd-4d1800595c89 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Mar 08 20:08:25.220796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 716/1466] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:26.159044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:26.159654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:26.165928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:26.166376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:26.167138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:26.167574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:26.231674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d579c35e-8413-4361-ab43-aa0377959dbc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:26.232793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d579c35e-8413-4361-ab43-aa0377959dbc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:26.239356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d579c35e-8413-4361-ab43-aa0377959dbc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:26.239812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d579c35e-8413-4361-ab43-aa0377959dbc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:26.240617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d579c35e-8413-4361-ab43-aa0377959dbc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:26.241055 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d579c35e-8413-4361-ab43-aa0377959dbc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:26.269961 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d579c35e-8413-4361-ab43-aa0377959dbc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042787 Mar 08 20:08:26.270530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 717/1467] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:08:26.298509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:26.306188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7bbd4f16-ec2a-4e12-b6b5-028382ca4dc4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150944 Mar 08 20:08:26.306754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 751/1468] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:26 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:27.281397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ca2724b0-8dd4-4158-9a78-a35872ba063f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:27.282349 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ca2724b0-8dd4-4158-9a78-a35872ba063f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:27.288650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ca2724b0-8dd4-4158-9a78-a35872ba063f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:27.289105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ca2724b0-8dd4-4158-9a78-a35872ba063f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:27.290379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ca2724b0-8dd4-4158-9a78-a35872ba063f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:27.290820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ca2724b0-8dd4-4158-9a78-a35872ba063f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:27.318846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ca2724b0-8dd4-4158-9a78-a35872ba063f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041416 Mar 08 20:08:27.319395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 718/1469] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:27.325800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:27.327908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:27.335206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:27.335650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:27.336446 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:27.336913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:27.478440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:27.486020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-92d880b7-78ff-4a00-ad33-5c51932383ea tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.166948 Mar 08 20:08:27.486576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 752/1470] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:27 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:08:28.330399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a18bab19-6fbf-4b2f-bfdb-a3cd6277b37a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:28.331317 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a18bab19-6fbf-4b2f-bfdb-a3cd6277b37a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:28.337528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a18bab19-6fbf-4b2f-bfdb-a3cd6277b37a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:28.337979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a18bab19-6fbf-4b2f-bfdb-a3cd6277b37a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:28.338748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a18bab19-6fbf-4b2f-bfdb-a3cd6277b37a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:28.339185 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a18bab19-6fbf-4b2f-bfdb-a3cd6277b37a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:28.366519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a18bab19-6fbf-4b2f-bfdb-a3cd6277b37a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040212 Mar 08 20:08:28.367064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 719/1471] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:28.502693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:28.503299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:28.509438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:28.509876 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:28.510640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:28.511067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:28.641374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:28.649945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-251ca5d1-c414-41b3-8c95-3f6f3e6f54cf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150189 Mar 08 20:08:28.650497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 753/1472] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:28 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:29.378745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-31772392-e42f-439a-bb25-3f83463ac813 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:29.379633 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-31772392-e42f-439a-bb25-3f83463ac813 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:29.386371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31772392-e42f-439a-bb25-3f83463ac813 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:29.386825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31772392-e42f-439a-bb25-3f83463ac813 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:29.387597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31772392-e42f-439a-bb25-3f83463ac813 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:29.388037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31772392-e42f-439a-bb25-3f83463ac813 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:29.416046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-31772392-e42f-439a-bb25-3f83463ac813 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Mar 08 20:08:29.416623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 720/1473] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:29.666736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:29.667304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:29.673519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:29.673965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:29.674727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:29.675159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:29.810490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:29.818144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-04deb649-ea1a-463e-864e-ba29a802e02f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155392 Mar 08 20:08:29.818707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 754/1474] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:29 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:30.427163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-834cdc21-817a-4b16-9853-d9b6031d15ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:30.428011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-834cdc21-817a-4b16-9853-d9b6031d15ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:30.434352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-834cdc21-817a-4b16-9853-d9b6031d15ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:30.434805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-834cdc21-817a-4b16-9853-d9b6031d15ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:30.435574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-834cdc21-817a-4b16-9853-d9b6031d15ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:30.436013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-834cdc21-817a-4b16-9853-d9b6031d15ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:30.464184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-834cdc21-817a-4b16-9853-d9b6031d15ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041057 Mar 08 20:08:30.464763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 721/1475] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:30.835806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:30.836435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:30.843299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:30.843748 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:30.844545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:30.844979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:30.971461 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:30.979123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bd8b5d9f-8bf3-4bb8-9c42-771bcacb88da tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147173 Mar 08 20:08:30.979682 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 755/1476] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:30 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:31.475058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dfb9e729-3c34-41e0-8bbd-1c1efea1dbd0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:31.475976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dfb9e729-3c34-41e0-8bbd-1c1efea1dbd0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:31.482881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfb9e729-3c34-41e0-8bbd-1c1efea1dbd0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:31.483341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfb9e729-3c34-41e0-8bbd-1c1efea1dbd0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:31.484109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfb9e729-3c34-41e0-8bbd-1c1efea1dbd0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:31.484574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dfb9e729-3c34-41e0-8bbd-1c1efea1dbd0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:31.515044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dfb9e729-3c34-41e0-8bbd-1c1efea1dbd0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Mar 08 20:08:31.515613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 722/1477] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:31.996516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:31.997079 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:32.003222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:32.003664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:32.004455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:32.004886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:32.137757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:32.145438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c36abce1-96fe-4346-a571-aae5ae87b252 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152824 Mar 08 20:08:32.145993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 756/1478] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:31 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:32.527439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-44b66f2b-33a2-4d48-add4-480bf91654db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:32.528378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-44b66f2b-33a2-4d48-add4-480bf91654db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:32.534610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44b66f2b-33a2-4d48-add4-480bf91654db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:32.535053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44b66f2b-33a2-4d48-add4-480bf91654db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:32.535810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44b66f2b-33a2-4d48-add4-480bf91654db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:32.536239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44b66f2b-33a2-4d48-add4-480bf91654db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:32.563390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-44b66f2b-33a2-4d48-add4-480bf91654db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040869 Mar 08 20:08:32.563953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 723/1479] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:33.162983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:33.163583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:33.169818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:33.170268 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:33.171032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:33.171465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:33.300433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:33.308690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-96bfdcd0-8b9a-48ce-9392-2bf5fc8bc490 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149506 Mar 08 20:08:33.309257 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 757/1480] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:33 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:33.574030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f0311dfa-d85f-46d6-b2a1-4ed9175225f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:33.574935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f0311dfa-d85f-46d6-b2a1-4ed9175225f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:33.581143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0311dfa-d85f-46d6-b2a1-4ed9175225f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:33.581583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0311dfa-d85f-46d6-b2a1-4ed9175225f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:33.582338 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0311dfa-d85f-46d6-b2a1-4ed9175225f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:33.582762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0311dfa-d85f-46d6-b2a1-4ed9175225f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:33.610626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f0311dfa-d85f-46d6-b2a1-4ed9175225f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Mar 08 20:08:33.611165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 724/1481] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:34.326280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:34.326874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:34.333098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:34.333548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:34.334307 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:34.334742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:34.463469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:34.471431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-255a2951-9bdc-42cf-987b-b6751209c7fd tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.149335 Mar 08 20:08:34.472007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 758/1482] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:34 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:34.622622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-97d849ab-01e1-474b-8793-d29ef591fdc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:34.623529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-97d849ab-01e1-474b-8793-d29ef591fdc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:34.630011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97d849ab-01e1-474b-8793-d29ef591fdc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:34.630473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97d849ab-01e1-474b-8793-d29ef591fdc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:34.631245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97d849ab-01e1-474b-8793-d29ef591fdc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:34.631686 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97d849ab-01e1-474b-8793-d29ef591fdc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:34.660057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-97d849ab-01e1-474b-8793-d29ef591fdc6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041930 Mar 08 20:08:34.660659 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 725/1483] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:35.488545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:35.489147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:35.495732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:35.496189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:35.497017 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:35.497447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:35.633165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:35.641472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-db1e0737-5abd-42b5-babd-11d1972c86c6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.156903 Mar 08 20:08:35.642039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 759/1484] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:35 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:35.671457 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0718ef90-a3ae-42f3-8c91-1a87ec7b3452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:35.672399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0718ef90-a3ae-42f3-8c91-1a87ec7b3452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:35.678695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0718ef90-a3ae-42f3-8c91-1a87ec7b3452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:35.679370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0718ef90-a3ae-42f3-8c91-1a87ec7b3452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:35.680144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0718ef90-a3ae-42f3-8c91-1a87ec7b3452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:35.680608 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0718ef90-a3ae-42f3-8c91-1a87ec7b3452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:35.709553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0718ef90-a3ae-42f3-8c91-1a87ec7b3452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Mar 08 20:08:35.710111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 726/1485] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:36.659356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:36.659961 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:36.666259 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:36.666708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:36.667473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:36.667912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:36.721111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ab9465f5-2dcb-4066-9796-057951c5cbaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:36.722217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ab9465f5-2dcb-4066-9796-057951c5cbaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:36.728323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab9465f5-2dcb-4066-9796-057951c5cbaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:36.728887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab9465f5-2dcb-4066-9796-057951c5cbaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:36.729676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab9465f5-2dcb-4066-9796-057951c5cbaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:36.730115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ab9465f5-2dcb-4066-9796-057951c5cbaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:36.759883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ab9465f5-2dcb-4066-9796-057951c5cbaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042837 Mar 08 20:08:36.760467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 727/1486] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:08:36.798001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:36.805725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-02ef80d0-1b21-4fc1-8d04-0c449c6c9d81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150314 Mar 08 20:08:36.806285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 760/1487] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:36 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:37.772190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c69d7ff4-1242-4567-9606-516bf1afc363 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:37.773131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c69d7ff4-1242-4567-9606-516bf1afc363 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:37.780141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c69d7ff4-1242-4567-9606-516bf1afc363 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:37.780628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c69d7ff4-1242-4567-9606-516bf1afc363 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:37.781402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c69d7ff4-1242-4567-9606-516bf1afc363 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:37.781842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c69d7ff4-1242-4567-9606-516bf1afc363 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:37.810308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c69d7ff4-1242-4567-9606-516bf1afc363 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Mar 08 20:08:37.810859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 728/1488] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:37.823687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:37.824863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:37.831363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:37.831812 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:37.832605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:37.833041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:37.963829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:37.972016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-148a2239-0ac1-456b-87b3-bfa07513a919 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152129 Mar 08 20:08:37.972611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 761/1489] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:37 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:08:38.822282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0466f393-7f12-4be0-b29b-dfc487127383 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:38.823216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0466f393-7f12-4be0-b29b-dfc487127383 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:38.829471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0466f393-7f12-4be0-b29b-dfc487127383 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:38.829918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0466f393-7f12-4be0-b29b-dfc487127383 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:38.830686 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0466f393-7f12-4be0-b29b-dfc487127383 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:38.831120 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0466f393-7f12-4be0-b29b-dfc487127383 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:38.860074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0466f393-7f12-4be0-b29b-dfc487127383 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Mar 08 20:08:38.860667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 729/1490] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:38.989127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:38.989654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:38.996005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:38.996484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:38.997242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:38.997686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:39.130807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:39.138576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-983fc8a4-2892-4642-809f-8a89d4956c97 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153341 Mar 08 20:08:39.139112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 762/1491] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:38 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:39.872146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bd777939-c494-44fe-9b13-7c473646f946 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:39.873096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bd777939-c494-44fe-9b13-7c473646f946 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:39.879345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd777939-c494-44fe-9b13-7c473646f946 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:39.879785 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd777939-c494-44fe-9b13-7c473646f946 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:39.880590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd777939-c494-44fe-9b13-7c473646f946 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:39.881022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bd777939-c494-44fe-9b13-7c473646f946 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:39.908652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bd777939-c494-44fe-9b13-7c473646f946 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040928 Mar 08 20:08:39.909184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 730/1492] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:40.155677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:40.156223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:40.162533 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:40.162985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:40.163752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:40.164221 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:40.296688 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:40.304333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0abdfdab-6163-4f40-9684-edf3022722a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152566 Mar 08 20:08:40.304894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 763/1493] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:40 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:40.920084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7bc60bf3-9f2e-449a-8bee-d52acc76d72a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:40.921023 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7bc60bf3-9f2e-449a-8bee-d52acc76d72a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:40.927431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7bc60bf3-9f2e-449a-8bee-d52acc76d72a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:40.927883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7bc60bf3-9f2e-449a-8bee-d52acc76d72a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:40.928694 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7bc60bf3-9f2e-449a-8bee-d52acc76d72a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:40.929133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7bc60bf3-9f2e-449a-8bee-d52acc76d72a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:40.956691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7bc60bf3-9f2e-449a-8bee-d52acc76d72a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040567 Mar 08 20:08:40.957225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 731/1494] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:41.321587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:41.322341 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:41.328789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:41.329239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:41.330012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:41.330451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:41.465121 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:41.472793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e639bc34-4b4c-4b8d-968e-fe1478fb7a20 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155078 Mar 08 20:08:41.473362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 764/1495] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:41 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:41.968047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b0bada86-f939-4446-b5db-c0af5c87f488 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:41.968983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b0bada86-f939-4446-b5db-c0af5c87f488 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:41.975363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0bada86-f939-4446-b5db-c0af5c87f488 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:41.975808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0bada86-f939-4446-b5db-c0af5c87f488 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:41.976600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0bada86-f939-4446-b5db-c0af5c87f488 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:41.977038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0bada86-f939-4446-b5db-c0af5c87f488 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:42.004863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b0bada86-f939-4446-b5db-c0af5c87f488 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 Mar 08 20:08:42.005411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 732/1496] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:42.489746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:42.490407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:42.497156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:42.497606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:42.498396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:42.498830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:42.637021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:42.644734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6e50f276-995f-4bc7-8681-20807da1dac2 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.158822 Mar 08 20:08:42.645299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 765/1497] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:42 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:43.016159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eb800518-a6da-450e-8eab-ca78a7ac4e9d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:43.017019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eb800518-a6da-450e-8eab-ca78a7ac4e9d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:43.023249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb800518-a6da-450e-8eab-ca78a7ac4e9d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:43.023707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb800518-a6da-450e-8eab-ca78a7ac4e9d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:43.024762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb800518-a6da-450e-8eab-ca78a7ac4e9d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:43.025204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb800518-a6da-450e-8eab-ca78a7ac4e9d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:43.053516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eb800518-a6da-450e-8eab-ca78a7ac4e9d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Mar 08 20:08:43.054061 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 733/1498] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:43.662603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:43.663148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:43.669397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:43.669849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:43.670611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:43.671048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:43.802740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:43.811028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-681ea618-9ae1-488c-8850-940bc3e868aa tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152351 Mar 08 20:08:43.811584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 766/1499] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:43 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:08:44.065042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bef36fa4-5f8a-47b1-a97d-3f4867e8c9c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:44.065913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bef36fa4-5f8a-47b1-a97d-3f4867e8c9c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:44.072266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bef36fa4-5f8a-47b1-a97d-3f4867e8c9c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:44.072763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bef36fa4-5f8a-47b1-a97d-3f4867e8c9c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:44.073536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bef36fa4-5f8a-47b1-a97d-3f4867e8c9c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:44.073978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bef36fa4-5f8a-47b1-a97d-3f4867e8c9c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:44.102394 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bef36fa4-5f8a-47b1-a97d-3f4867e8c9c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041419 Mar 08 20:08:44.102935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 734/1500] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:44.828357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:44.828973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:44.835199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:44.835650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:44.836448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:44.836891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:44.963612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:44.971803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-809d88c7-f9ca-49c2-8972-7472c6ae4aa0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147811 Mar 08 20:08:44.972384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 767/1501] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:44 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:45.113650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b42f05a4-8341-4732-8963-c1691188968b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:45.114566 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b42f05a4-8341-4732-8963-c1691188968b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:45.121600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b42f05a4-8341-4732-8963-c1691188968b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:45.122101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b42f05a4-8341-4732-8963-c1691188968b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:45.122875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b42f05a4-8341-4732-8963-c1691188968b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:45.123310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b42f05a4-8341-4732-8963-c1691188968b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:45.151524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b42f05a4-8341-4732-8963-c1691188968b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041859 Mar 08 20:08:45.152062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 735/1502] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:45.988993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:45.989599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:45.996432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:45.996885 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:45.997650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:45.998081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:46.129486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:46.137203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3f5904f7-dede-4161-9737-965727762124 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152077 Mar 08 20:08:46.137762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 768/1503] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:45 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:46.162939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e429d61e-83ea-4d0b-9570-4a67741c334b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:46.163853 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e429d61e-83ea-4d0b-9570-4a67741c334b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:46.170603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e429d61e-83ea-4d0b-9570-4a67741c334b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:46.171054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e429d61e-83ea-4d0b-9570-4a67741c334b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:46.171814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e429d61e-83ea-4d0b-9570-4a67741c334b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:46.172252 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e429d61e-83ea-4d0b-9570-4a67741c334b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:46.200157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e429d61e-83ea-4d0b-9570-4a67741c334b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041161 Mar 08 20:08:46.200731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 736/1504] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:47.154805 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:47.155399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:47.161659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:47.162101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:47.162854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:47.163280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:47.211152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-378e30a1-a102-45dc-a175-bc95e5353df2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:47.212062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-378e30a1-a102-45dc-a175-bc95e5353df2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:47.218755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-378e30a1-a102-45dc-a175-bc95e5353df2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:47.219206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-378e30a1-a102-45dc-a175-bc95e5353df2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:47.219970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-378e30a1-a102-45dc-a175-bc95e5353df2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:47.220428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-378e30a1-a102-45dc-a175-bc95e5353df2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:47.250322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-378e30a1-a102-45dc-a175-bc95e5353df2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Mar 08 20:08:47.250902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 737/1505] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:08:47.298052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:47.305707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-18653dd8-b63d-42da-ac2d-32999bd4c8fb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.155233 Mar 08 20:08:47.306309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 769/1506] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:47 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:48.263944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d6aa00aa-7ca9-4ba5-a948-698a49198836 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:48.264878 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d6aa00aa-7ca9-4ba5-a948-698a49198836 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:48.271101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6aa00aa-7ca9-4ba5-a948-698a49198836 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:48.271548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6aa00aa-7ca9-4ba5-a948-698a49198836 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:48.272331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6aa00aa-7ca9-4ba5-a948-698a49198836 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:48.272769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6aa00aa-7ca9-4ba5-a948-698a49198836 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:48.300432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d6aa00aa-7ca9-4ba5-a948-698a49198836 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041016 Mar 08 20:08:48.300978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 738/1507] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:48.322675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:48.323303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:48.329481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:48.329933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:48.330692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:48.331125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:48.458311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:48.466019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-72cb6b8f-05f7-4bc8-b3dd-c6eac94d0f8c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147126 Mar 08 20:08:48.466581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 770/1508] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:48 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:49.312663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-22bf5971-be59-4c1c-a5e6-72e9c1e84a07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:49.314022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-22bf5971-be59-4c1c-a5e6-72e9c1e84a07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:49.323148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22bf5971-be59-4c1c-a5e6-72e9c1e84a07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:49.323814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22bf5971-be59-4c1c-a5e6-72e9c1e84a07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:49.325523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22bf5971-be59-4c1c-a5e6-72e9c1e84a07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:49.326155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-22bf5971-be59-4c1c-a5e6-72e9c1e84a07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:49.356010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-22bf5971-be59-4c1c-a5e6-72e9c1e84a07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048852 Mar 08 20:08:49.356728 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 739/1509] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:49.482914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:49.483431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:49.489731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:49.490182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:49.490947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:49.491381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:49.624091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:49.631884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7390b23e-27fc-47f6-9162-7b68336e11e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152971 Mar 08 20:08:49.632468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 771/1510] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:49 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:50.367173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-891fea43-6593-4482-8278-8f59c0268ec6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:50.368002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-891fea43-6593-4482-8278-8f59c0268ec6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:50.374769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-891fea43-6593-4482-8278-8f59c0268ec6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:50.375216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-891fea43-6593-4482-8278-8f59c0268ec6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:50.375976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-891fea43-6593-4482-8278-8f59c0268ec6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:50.376441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-891fea43-6593-4482-8278-8f59c0268ec6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:50.405395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-891fea43-6593-4482-8278-8f59c0268ec6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 Mar 08 20:08:50.405951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 740/1511] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:50.649333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:50.649878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:50.656277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:50.656763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:50.657528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:50.657965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:50.784848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:50.792547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4f1b3d84-7d4c-4274-86a6-be699b97e22f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.147498 Mar 08 20:08:50.793110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 772/1512] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:50 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:51.416788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-370110b9-9fb7-4c43-b486-4d64a7ef0600 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:51.418238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-370110b9-9fb7-4c43-b486-4d64a7ef0600 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:51.424486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-370110b9-9fb7-4c43-b486-4d64a7ef0600 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:51.424940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-370110b9-9fb7-4c43-b486-4d64a7ef0600 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:51.425699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-370110b9-9fb7-4c43-b486-4d64a7ef0600 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:51.426133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-370110b9-9fb7-4c43-b486-4d64a7ef0600 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:51.453864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-370110b9-9fb7-4c43-b486-4d64a7ef0600 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Mar 08 20:08:51.454417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 741/1513] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:51.809856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:51.810408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:51.816678 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:51.817129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:51.817892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:51.818325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:51.951312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:51.958992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9d46e78b-100a-48d8-8cad-f3310ee25f32 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.153530 Mar 08 20:08:51.959555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 773/1514] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:51 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:52.465936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a5b16b3b-b880-44d7-a7d7-0125ed648b42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:52.466786 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a5b16b3b-b880-44d7-a7d7-0125ed648b42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:52.473014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5b16b3b-b880-44d7-a7d7-0125ed648b42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:52.473479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5b16b3b-b880-44d7-a7d7-0125ed648b42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:52.474247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5b16b3b-b880-44d7-a7d7-0125ed648b42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:52.474682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5b16b3b-b880-44d7-a7d7-0125ed648b42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:52.503116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a5b16b3b-b880-44d7-a7d7-0125ed648b42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 Mar 08 20:08:52.503670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 742/1515] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:52.975866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:52.976609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:52.982797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:52.983252 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:52.984022 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:52.984493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:53.069798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:08:53.069978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:08:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:08:53.116343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:53.124709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-de925e2e-9cef-4578-8a98-8e48e2b13581 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.152636 Mar 08 20:08:53.125267 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 774/1516] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:52 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:53.515181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-86c78963-4ff0-4d36-b988-067aae32f9e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:53.516200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-86c78963-4ff0-4d36-b988-067aae32f9e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:53.523053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c78963-4ff0-4d36-b988-067aae32f9e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:53.523507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c78963-4ff0-4d36-b988-067aae32f9e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:53.524679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c78963-4ff0-4d36-b988-067aae32f9e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:53.525212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c78963-4ff0-4d36-b988-067aae32f9e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:53.555103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-86c78963-4ff0-4d36-b988-067aae32f9e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Mar 08 20:08:53.555667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 743/1517] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:54.143304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:54.143913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:54.150560 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:54.151015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:54.151790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:54.152260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:54.281915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:54.289734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-04276dc4-a98c-4920-9283-e2f4939b11ae tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1559 microversion: 2.1 time: 0.150191 Mar 08 20:08:54.290302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 775/1518] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:54 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:54.567426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4840bbd9-c51b-47db-9072-0aeed7a8de0e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:54.568839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4840bbd9-c51b-47db-9072-0aeed7a8de0e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:54.581058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4840bbd9-c51b-47db-9072-0aeed7a8de0e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:54.581507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4840bbd9-c51b-47db-9072-0aeed7a8de0e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:54.582289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4840bbd9-c51b-47db-9072-0aeed7a8de0e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:54.582783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4840bbd9-c51b-47db-9072-0aeed7a8de0e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:54.594819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-51dbc77f-0a8c-4619-846d-716378518cb2 req-ee703cf6-7300-48a2-be0f-5dceb1ace627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf15cfb8-7c73-418b-b268-1fc064fc717f", "name": "network-vif-deleted", "tag": "b795f2a0-a5c0-454f-8fbe-956e41ba2c9c"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:08:54.602700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-51dbc77f-0a8c-4619-846d-716378518cb2 req-ee703cf6-7300-48a2-be0f-5dceb1ace627 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:54.603144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-51dbc77f-0a8c-4619-846d-716378518cb2 req-ee703cf6-7300-48a2-be0f-5dceb1ace627 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:54.613589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4840bbd9-c51b-47db-9072-0aeed7a8de0e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050210 Mar 08 20:08:54.613925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-51dbc77f-0a8c-4619-846d-716378518cb2 req-ee703cf6-7300-48a2-be0f-5dceb1ace627 service nova] Creating event network-vif-deleted:b795f2a0-a5c0-454f-8fbe-956e41ba2c9c for instance cf15cfb8-7c73-418b-b268-1fc064fc717f on hv-cinder-83009 Mar 08 20:08:54.614480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 776/1519] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:08:54.619751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-51dbc77f-0a8c-4619-846d-716378518cb2 req-ee703cf6-7300-48a2-be0f-5dceb1ace627 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088019 Mar 08 20:08:54.620345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 744/1520] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:55.307051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:55.307658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:55.314436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:55.314883 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:55.315670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:55.316105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:55.379041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:55.386933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-658e448f-0fcf-4280-8e19-7dae4e0ff392 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083714 Mar 08 20:08:55.387516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 777/1521] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:55 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:55.626461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-931850a8-1074-457e-809e-cd855083c2b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:55.627536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-931850a8-1074-457e-809e-cd855083c2b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:55.633599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-931850a8-1074-457e-809e-cd855083c2b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:55.634068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-931850a8-1074-457e-809e-cd855083c2b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:55.634817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-931850a8-1074-457e-809e-cd855083c2b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:55.635251 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-931850a8-1074-457e-809e-cd855083c2b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:55.663957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-931850a8-1074-457e-809e-cd855083c2b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042230 Mar 08 20:08:55.664537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 745/1522] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:56.403224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:56.403790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:56.410126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:56.410573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:56.411331 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:56.411762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:56.469874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:56.477452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-729afb34-23ab-4839-99b4-894733857441 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078135 Mar 08 20:08:56.478011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 778/1523] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:56 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:56.676026 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-763cdf27-22b9-423c-aaf7-6cb167b0d3bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:56.676886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-763cdf27-22b9-423c-aaf7-6cb167b0d3bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:56.683690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-763cdf27-22b9-423c-aaf7-6cb167b0d3bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:56.684165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-763cdf27-22b9-423c-aaf7-6cb167b0d3bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:56.684975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-763cdf27-22b9-423c-aaf7-6cb167b0d3bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:56.685418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-763cdf27-22b9-423c-aaf7-6cb167b0d3bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:56.712696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-763cdf27-22b9-423c-aaf7-6cb167b0d3bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040689 Mar 08 20:08:56.713251 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 746/1524] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:57.494450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:57.495008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:57.501771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:57.502216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:57.502976 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:57.503405 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:57.562184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:57.569860 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-937da289-bda9-4515-870c-19921bd8e350 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079331 Mar 08 20:08:57.570415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 779/1525] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:57 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:57.724108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-febbb00b-51bd-4ace-83c8-014dce45551f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:57.725040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-febbb00b-51bd-4ace-83c8-014dce45551f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:57.731905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-febbb00b-51bd-4ace-83c8-014dce45551f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:57.732392 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-febbb00b-51bd-4ace-83c8-014dce45551f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:57.733156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-febbb00b-51bd-4ace-83c8-014dce45551f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:57.733588 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-febbb00b-51bd-4ace-83c8-014dce45551f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:57.760611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-febbb00b-51bd-4ace-83c8-014dce45551f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040362 Mar 08 20:08:57.761079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 747/1526] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:58.586028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:58.586635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:58.592946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:58.593401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:58.594194 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:58.594626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:58.652998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:58.660578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-43cd8360-6c49-4f0e-9690-5f3a1b9aa5c5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078409 Mar 08 20:08:58.661134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 780/1527] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:58 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:58.770983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b6ed561b-c4f2-4f4f-b4ad-3ecff287af65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:58.771888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b6ed561b-c4f2-4f4f-b4ad-3ecff287af65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:58.779032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6ed561b-c4f2-4f4f-b4ad-3ecff287af65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:58.779479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6ed561b-c4f2-4f4f-b4ad-3ecff287af65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:58.780243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6ed561b-c4f2-4f4f-b4ad-3ecff287af65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:58.780705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6ed561b-c4f2-4f4f-b4ad-3ecff287af65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:58.808192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b6ed561b-c4f2-4f4f-b4ad-3ecff287af65 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Mar 08 20:08:58.808759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 748/1528] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:08:59.677783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:59.678382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:59.685230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:59.685684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:59.686452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:59.686888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:59.745141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:08:59.753489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9d0255bd-6184-4878-9e26-6398e80f3b98 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079635 Mar 08 20:08:59.754052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 781/1529] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:08:59 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:08:59.819895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-aef316a6-201a-400c-8b66-5e85ccce1189 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:08:59.821151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-aef316a6-201a-400c-8b66-5e85ccce1189 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:08:59.828235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aef316a6-201a-400c-8b66-5e85ccce1189 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:59.828746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aef316a6-201a-400c-8b66-5e85ccce1189 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:59.829514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aef316a6-201a-400c-8b66-5e85ccce1189 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:08:59.829955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aef316a6-201a-400c-8b66-5e85ccce1189 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:08:59.857810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-aef316a6-201a-400c-8b66-5e85ccce1189 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041836 Mar 08 20:08:59.858355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 749/1530] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:08:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:00.770028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:00.770635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:00.777677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:00.778125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:00.778882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:00.779322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:00.836456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:00.844645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-09610ab2-1c34-4066-ad83-48597bf74004 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078385 Mar 08 20:09:00.845211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 782/1531] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:00 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:00.869015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2463ad73-aac3-486e-ba93-8b11c40d4d46 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:00.869930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2463ad73-aac3-486e-ba93-8b11c40d4d46 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:00.876072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2463ad73-aac3-486e-ba93-8b11c40d4d46 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:00.876559 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2463ad73-aac3-486e-ba93-8b11c40d4d46 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:00.877329 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2463ad73-aac3-486e-ba93-8b11c40d4d46 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:00.877768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2463ad73-aac3-486e-ba93-8b11c40d4d46 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:00.907077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2463ad73-aac3-486e-ba93-8b11c40d4d46 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 Mar 08 20:09:00.907634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 750/1532] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:01.861411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:01.862023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:01.868468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:01.868905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:01.869663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:01.870092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:01.920412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0ec66d8a-da6c-4f5c-b271-ca90e6213329 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:01.921328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0ec66d8a-da6c-4f5c-b271-ca90e6213329 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:01.927618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ec66d8a-da6c-4f5c-b271-ca90e6213329 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:01.928072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ec66d8a-da6c-4f5c-b271-ca90e6213329 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:01.928883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ec66d8a-da6c-4f5c-b271-ca90e6213329 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:01.929328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ec66d8a-da6c-4f5c-b271-ca90e6213329 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:01.933622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:01.941269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-abba36f7-8816-414c-b00c-1ac62199764c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083707 Mar 08 20:09:01.941827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 783/1533] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:01 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:01.957835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0ec66d8a-da6c-4f5c-b271-ca90e6213329 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Mar 08 20:09:01.958371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 751/1534] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:09:02.958381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:02.958990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:02.965840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:02.966291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:02.967067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:02.967502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:02.969450 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8272381c-6daa-45cd-8bb8-5eadf4f8c162 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:02.970360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8272381c-6daa-45cd-8bb8-5eadf4f8c162 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:02.976452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8272381c-6daa-45cd-8bb8-5eadf4f8c162 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:02.976898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8272381c-6daa-45cd-8bb8-5eadf4f8c162 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:02.977656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8272381c-6daa-45cd-8bb8-5eadf4f8c162 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:02.978083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8272381c-6daa-45cd-8bb8-5eadf4f8c162 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:03.007083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8272381c-6daa-45cd-8bb8-5eadf4f8c162 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Mar 08 20:09:03.007567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 752/1535] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:09:03.026510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:03.034855 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-996a4273-37f5-45f3-8f44-eb0e14c98553 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080362 Mar 08 20:09:03.035411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 784/1536] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:02 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:04.018467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-09ccec5d-f561-4068-816d-35618ca152e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:04.019375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-09ccec5d-f561-4068-816d-35618ca152e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:04.026086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-09ccec5d-f561-4068-816d-35618ca152e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:04.026595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-09ccec5d-f561-4068-816d-35618ca152e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:04.027361 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-09ccec5d-f561-4068-816d-35618ca152e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:04.027820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-09ccec5d-f561-4068-816d-35618ca152e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:04.051874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:04.052514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:04.055646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-09ccec5d-f561-4068-816d-35618ca152e1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 Mar 08 20:09:04.056188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 753/1537] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:04.059442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:04.059895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:04.060776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:04.061217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:04.119785 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:04.128519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-de45d2c2-5ac3-4a22-b1a4-576b8635145f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080377 Mar 08 20:09:04.129183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 785/1538] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:04 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:09:05.067950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e9890bd4-239c-4067-87c5-5653cd1fbc64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:05.068899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e9890bd4-239c-4067-87c5-5653cd1fbc64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:05.075145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e9890bd4-239c-4067-87c5-5653cd1fbc64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:05.075597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e9890bd4-239c-4067-87c5-5653cd1fbc64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:05.076393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e9890bd4-239c-4067-87c5-5653cd1fbc64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:05.076831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e9890bd4-239c-4067-87c5-5653cd1fbc64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:05.103779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e9890bd4-239c-4067-87c5-5653cd1fbc64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039963 Mar 08 20:09:05.104335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 754/1539] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:05.144691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:05.145300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:05.152309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:05.152771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:05.153535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:05.153972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:05.212132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:05.219776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e3d022a7-981c-4694-a151-382fdd0c2473 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078866 Mar 08 20:09:05.220362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 786/1540] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:05 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:06.115559 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c8c0e821-9265-42e9-bdaa-81399db78a88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:06.116775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c8c0e821-9265-42e9-bdaa-81399db78a88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:06.123738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c8c0e821-9265-42e9-bdaa-81399db78a88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:06.124190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c8c0e821-9265-42e9-bdaa-81399db78a88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:06.124988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c8c0e821-9265-42e9-bdaa-81399db78a88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:06.125431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c8c0e821-9265-42e9-bdaa-81399db78a88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:06.154255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c8c0e821-9265-42e9-bdaa-81399db78a88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Mar 08 20:09:06.154811 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 755/1541] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:06.236735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:06.237345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:06.243528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:06.243973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:06.244773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:06.245196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:06.303872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:06.312076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8056c3ec-90d5-4479-8e4b-7d571c751977 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079103 Mar 08 20:09:06.312661 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 787/1542] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:06 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:07.165752 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a39fa732-eb37-440b-9823-e2ed8dc5fc22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:07.166668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a39fa732-eb37-440b-9823-e2ed8dc5fc22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:07.172703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a39fa732-eb37-440b-9823-e2ed8dc5fc22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:07.173161 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a39fa732-eb37-440b-9823-e2ed8dc5fc22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:07.173928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a39fa732-eb37-440b-9823-e2ed8dc5fc22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:07.174365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a39fa732-eb37-440b-9823-e2ed8dc5fc22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:07.202031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a39fa732-eb37-440b-9823-e2ed8dc5fc22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040354 Mar 08 20:09:07.202578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 756/1543] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:07.328662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:07.329284 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:07.335654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:07.336102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:07.336896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:07.337331 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:07.395649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:07.404033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e50445bd-588c-4e62-94bf-41f1ed305b29 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079161 Mar 08 20:09:07.404628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 788/1544] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:07 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:08.213425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1b9f076c-b112-4a76-9828-20d53181396f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:08.214397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1b9f076c-b112-4a76-9828-20d53181396f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:08.220668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b9f076c-b112-4a76-9828-20d53181396f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:08.221123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b9f076c-b112-4a76-9828-20d53181396f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:08.221888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b9f076c-b112-4a76-9828-20d53181396f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:08.222327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b9f076c-b112-4a76-9828-20d53181396f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:08.250747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1b9f076c-b112-4a76-9828-20d53181396f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Mar 08 20:09:08.251292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 757/1545] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:08.420497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:08.421102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:08.427219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:08.427691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:08.428480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:08.428911 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:08.709105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:08.717510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-134ca052-9bda-409b-b401-61819f0e4819 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.300866 Mar 08 20:09:08.718070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 789/1546] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:08 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:09.262213 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8318dc71-5a10-4d4b-a4e6-c07d07baceae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:09.263121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8318dc71-5a10-4d4b-a4e6-c07d07baceae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:09.269491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8318dc71-5a10-4d4b-a4e6-c07d07baceae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:09.269948 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8318dc71-5a10-4d4b-a4e6-c07d07baceae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:09.270717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8318dc71-5a10-4d4b-a4e6-c07d07baceae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:09.271151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8318dc71-5a10-4d4b-a4e6-c07d07baceae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:09.299858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8318dc71-5a10-4d4b-a4e6-c07d07baceae tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Mar 08 20:09:09.300428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 758/1547] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:09.734129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:09.734735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:09.740920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:09.741382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:09.742152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:09.742587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:09.801703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:09.809789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-41ea7b30-0314-420b-9505-6d14e9e96f51 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079537 Mar 08 20:09:09.810348 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 790/1548] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:09 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:10.311855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-530f6934-331e-422c-a941-5e7cdd98d845 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:10.312784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-530f6934-331e-422c-a941-5e7cdd98d845 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:10.318938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-530f6934-331e-422c-a941-5e7cdd98d845 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:10.319378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-530f6934-331e-422c-a941-5e7cdd98d845 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:10.320129 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-530f6934-331e-422c-a941-5e7cdd98d845 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:10.320578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-530f6934-331e-422c-a941-5e7cdd98d845 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:10.347931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-530f6934-331e-422c-a941-5e7cdd98d845 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040573 Mar 08 20:09:10.348501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 759/1549] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:10.826355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:10.826999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:10.833300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:10.833751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:10.834518 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:10.834953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:10.892930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:10.900780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0c8e32de-58cf-4194-913e-01153a61fac8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078253 Mar 08 20:09:10.901336 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 791/1550] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:10 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:11.359732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3620e76d-87c3-4f97-97d0-c9af9562311f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:11.360710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3620e76d-87c3-4f97-97d0-c9af9562311f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:11.367017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620e76d-87c3-4f97-97d0-c9af9562311f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:11.367410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620e76d-87c3-4f97-97d0-c9af9562311f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:11.368178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620e76d-87c3-4f97-97d0-c9af9562311f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:11.368658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3620e76d-87c3-4f97-97d0-c9af9562311f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:11.396365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3620e76d-87c3-4f97-97d0-c9af9562311f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040597 Mar 08 20:09:11.396915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 760/1551] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:11.918211 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:11.918846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:11.925309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:11.925762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:11.926566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:11.927001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:11.984583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:11.992223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-782a8089-edd8-4841-81a3-a35b6ea9b9ac tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078430 Mar 08 20:09:11.992885 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 792/1552] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:11 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:12.408279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ceb3f2c2-e4b7-426f-a512-8f25c656e064 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:12.409287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ceb3f2c2-e4b7-426f-a512-8f25c656e064 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:12.415567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ceb3f2c2-e4b7-426f-a512-8f25c656e064 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:12.416024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ceb3f2c2-e4b7-426f-a512-8f25c656e064 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:12.416826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ceb3f2c2-e4b7-426f-a512-8f25c656e064 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:12.417269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ceb3f2c2-e4b7-426f-a512-8f25c656e064 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:12.444376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ceb3f2c2-e4b7-426f-a512-8f25c656e064 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040056 Mar 08 20:09:12.444917 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 761/1553] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:13.009369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:13.009902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:13.016249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:13.016726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:13.017492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:13.017925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:13.078878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:13.086523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-be5b16b3-474a-423c-afa6-3b5cb810c73e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081125 Mar 08 20:09:13.087088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 793/1554] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:13 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:13.455717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7e1c2831-1abb-4c05-bac9-ef6bfdf18b8a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:13.456647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7e1c2831-1abb-4c05-bac9-ef6bfdf18b8a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:13.462880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e1c2831-1abb-4c05-bac9-ef6bfdf18b8a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:13.463327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e1c2831-1abb-4c05-bac9-ef6bfdf18b8a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:13.464677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e1c2831-1abb-4c05-bac9-ef6bfdf18b8a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:13.465107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7e1c2831-1abb-4c05-bac9-ef6bfdf18b8a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:13.493319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7e1c2831-1abb-4c05-bac9-ef6bfdf18b8a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041564 Mar 08 20:09:13.493864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 762/1555] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:14.102948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:14.103828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:14.110694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:14.111146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:14.111912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:14.112375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:14.171777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:14.179394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-45096afa-62a1-4833-92f1-909fc1bb6b0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080302 Mar 08 20:09:14.179951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 794/1556] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:14 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:14.504908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-12f48e25-c578-44b3-aef7-161409298d3b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:14.505724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-12f48e25-c578-44b3-aef7-161409298d3b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:14.511872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12f48e25-c578-44b3-aef7-161409298d3b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:14.512350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12f48e25-c578-44b3-aef7-161409298d3b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:14.513110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12f48e25-c578-44b3-aef7-161409298d3b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:14.513540 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12f48e25-c578-44b3-aef7-161409298d3b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:14.541191 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-12f48e25-c578-44b3-aef7-161409298d3b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040390 Mar 08 20:09:14.541723 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 763/1557] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:15.195991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:15.196626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:15.202963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:15.203416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:15.204181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:15.204647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:15.267908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:15.275879 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-501f4ef4-1dec-411c-91e5-1135f504cfd5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083745 Mar 08 20:09:15.276963 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 795/1558] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:15 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:15.553335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b53bef26-4111-4c23-b7ad-ca59c1186ca8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:15.554167 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b53bef26-4111-4c23-b7ad-ca59c1186ca8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:15.560478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b53bef26-4111-4c23-b7ad-ca59c1186ca8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:15.560962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b53bef26-4111-4c23-b7ad-ca59c1186ca8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:15.561731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b53bef26-4111-4c23-b7ad-ca59c1186ca8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:15.562168 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b53bef26-4111-4c23-b7ad-ca59c1186ca8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:15.590592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b53bef26-4111-4c23-b7ad-ca59c1186ca8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Mar 08 20:09:15.591131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 764/1559] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:16.293495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:16.294103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:16.300399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:16.300854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:16.301620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:16.302056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:16.362395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:16.370080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dc04e404-6724-4cfd-a8d2-e7a5d8859ad8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080801 Mar 08 20:09:16.371188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 796/1560] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:16 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:16.601540 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c351021c-4ee6-4df6-9e1c-9992ae2f19c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:16.602488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c351021c-4ee6-4df6-9e1c-9992ae2f19c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:16.609335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c351021c-4ee6-4df6-9e1c-9992ae2f19c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:16.609782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c351021c-4ee6-4df6-9e1c-9992ae2f19c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:16.610543 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c351021c-4ee6-4df6-9e1c-9992ae2f19c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:16.610979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c351021c-4ee6-4df6-9e1c-9992ae2f19c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:16.640713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c351021c-4ee6-4df6-9e1c-9992ae2f19c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Mar 08 20:09:16.641194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 765/1561] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:17.387831 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:17.388379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:17.394628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:17.395088 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:17.395844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:17.396279 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:17.454144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:17.461811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c373f7fb-478e-4015-9f04-c1a88b8718ee tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078507 Mar 08 20:09:17.462369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 797/1562] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:17 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:17.652795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-34da15d9-f57a-4ba2-8437-4b1b50dd6194 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:17.653632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-34da15d9-f57a-4ba2-8437-4b1b50dd6194 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:17.660030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34da15d9-f57a-4ba2-8437-4b1b50dd6194 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:17.660511 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34da15d9-f57a-4ba2-8437-4b1b50dd6194 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:17.661276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34da15d9-f57a-4ba2-8437-4b1b50dd6194 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:17.661708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34da15d9-f57a-4ba2-8437-4b1b50dd6194 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:17.688671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-34da15d9-f57a-4ba2-8437-4b1b50dd6194 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040746 Mar 08 20:09:17.689210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 766/1563] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:18.479880 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:18.480487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:18.486716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:18.487166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:18.487928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:18.488457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:18.549902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:18.558196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-95746f42-f377-4cfc-b75d-45418765521b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.082125 Mar 08 20:09:18.558763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 798/1564] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:18 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:18.699900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2675ec28-7e3d-4bf8-b0e5-aab830462dc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:18.700841 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2675ec28-7e3d-4bf8-b0e5-aab830462dc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:18.707080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2675ec28-7e3d-4bf8-b0e5-aab830462dc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:18.707534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2675ec28-7e3d-4bf8-b0e5-aab830462dc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:18.708309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2675ec28-7e3d-4bf8-b0e5-aab830462dc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:18.708759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2675ec28-7e3d-4bf8-b0e5-aab830462dc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:18.737131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2675ec28-7e3d-4bf8-b0e5-aab830462dc7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041132 Mar 08 20:09:18.737606 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 767/1565] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:18.968533 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:09:18.968782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:09:19.575067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:19.575724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:19.581877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:19.582320 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:19.583072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:19.583502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:19.641632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:19.649431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-87d6ea05-1a17-4966-ba0d-a4dd06df2129 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078181 Mar 08 20:09:19.649991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 799/1566] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:19 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:19.748043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-703ab407-9b75-422a-9df4-2a73886df9a7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:19.748989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-703ab407-9b75-422a-9df4-2a73886df9a7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:19.755181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-703ab407-9b75-422a-9df4-2a73886df9a7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:19.755614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-703ab407-9b75-422a-9df4-2a73886df9a7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:19.756410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-703ab407-9b75-422a-9df4-2a73886df9a7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:19.756848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-703ab407-9b75-422a-9df4-2a73886df9a7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:19.784484 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-703ab407-9b75-422a-9df4-2a73886df9a7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040342 Mar 08 20:09:19.785022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 768/1567] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:20.670642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:20.671255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:20.677338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:20.677789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:20.678566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:20.679005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:20.736865 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:20.744539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-650cde1b-e69e-4466-a1d6-ced6c9c30b26 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081820 Mar 08 20:09:20.745136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 800/1568] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:20 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:20.794886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-37f138e5-43bf-44c0-a97d-bc78abb20e07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:20.795795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-37f138e5-43bf-44c0-a97d-bc78abb20e07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:20.801960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-37f138e5-43bf-44c0-a97d-bc78abb20e07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:20.802405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-37f138e5-43bf-44c0-a97d-bc78abb20e07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:20.803162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-37f138e5-43bf-44c0-a97d-bc78abb20e07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:20.803596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-37f138e5-43bf-44c0-a97d-bc78abb20e07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:20.831115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-37f138e5-43bf-44c0-a97d-bc78abb20e07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040187 Mar 08 20:09:20.831644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 769/1569] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:21.761206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:21.761882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:21.768145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:21.768616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:21.769373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:21.769799 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:21.827792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:21.835388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b426d484-ac2e-422f-8ca7-52613b35f6b3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078042 Mar 08 20:09:21.835954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 801/1570] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:21 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:21.842947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-36aa344a-1dea-4f87-a6b7-062586cfe87a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:21.843893 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-36aa344a-1dea-4f87-a6b7-062586cfe87a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:21.850125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36aa344a-1dea-4f87-a6b7-062586cfe87a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:21.850581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36aa344a-1dea-4f87-a6b7-062586cfe87a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:21.851345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36aa344a-1dea-4f87-a6b7-062586cfe87a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:21.851814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36aa344a-1dea-4f87-a6b7-062586cfe87a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:21.879739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-36aa344a-1dea-4f87-a6b7-062586cfe87a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041263 Mar 08 20:09:21.880274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 770/1571] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:22.852689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:22.853300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:22.859603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:22.860056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:22.860851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:22.861289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:22.891277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-67cf7be8-0ae4-4cd6-bb9a-264ef35862a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:22.892196 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-67cf7be8-0ae4-4cd6-bb9a-264ef35862a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:22.898786 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67cf7be8-0ae4-4cd6-bb9a-264ef35862a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:22.899245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67cf7be8-0ae4-4cd6-bb9a-264ef35862a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:22.900024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67cf7be8-0ae4-4cd6-bb9a-264ef35862a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:22.900491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67cf7be8-0ae4-4cd6-bb9a-264ef35862a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:22.919407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:22.927177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-53f041fc-7916-4ee5-b272-c236849edbf3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078392 Mar 08 20:09:22.927747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 802/1572] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:22 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:22.930067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-67cf7be8-0ae4-4cd6-bb9a-264ef35862a8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Mar 08 20:09:22.930648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 771/1573] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:09:23.941620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-77e85edf-5f9d-4325-a4b8-bd03e997cdb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:23.942527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-77e85edf-5f9d-4325-a4b8-bd03e997cdb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:23.943610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:23.944222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:23.949484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77e85edf-5f9d-4325-a4b8-bd03e997cdb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:23.949926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77e85edf-5f9d-4325-a4b8-bd03e997cdb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:23.950690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77e85edf-5f9d-4325-a4b8-bd03e997cdb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:23.951121 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-77e85edf-5f9d-4325-a4b8-bd03e997cdb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:23.951307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:23.951755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:23.952546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:23.952980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:23.978395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-77e85edf-5f9d-4325-a4b8-bd03e997cdb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040736 Mar 08 20:09:23.978937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 803/1574] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:24.013272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:24.020877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7216919d-ae0d-47f5-8659-04671b56ae81 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081243 Mar 08 20:09:24.021426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 772/1575] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:23 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:09:24.989816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-951ec79a-4f2e-40f7-8ed4-0c45b9c8d35d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:24.990710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-951ec79a-4f2e-40f7-8ed4-0c45b9c8d35d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:24.997415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-951ec79a-4f2e-40f7-8ed4-0c45b9c8d35d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:24.997858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-951ec79a-4f2e-40f7-8ed4-0c45b9c8d35d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:24.998607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-951ec79a-4f2e-40f7-8ed4-0c45b9c8d35d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:24.999038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-951ec79a-4f2e-40f7-8ed4-0c45b9c8d35d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:25.028334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-951ec79a-4f2e-40f7-8ed4-0c45b9c8d35d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042332 Mar 08 20:09:25.028804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 804/1576] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:25.038483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:25.039102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:25.045814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:25.046262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:25.047028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:25.047464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:25.106513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:25.114291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cf6a0ab7-920a-4474-ad22-dcf9083ec984 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079610 Mar 08 20:09:25.114864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 773/1577] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:25 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:26.039873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b61208e9-77d7-40df-8e0b-85910c542889 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:26.040830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b61208e9-77d7-40df-8e0b-85910c542889 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:26.047586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b61208e9-77d7-40df-8e0b-85910c542889 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:26.048029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b61208e9-77d7-40df-8e0b-85910c542889 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:26.048818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b61208e9-77d7-40df-8e0b-85910c542889 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:26.049256 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b61208e9-77d7-40df-8e0b-85910c542889 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:26.076745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b61208e9-77d7-40df-8e0b-85910c542889 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040842 Mar 08 20:09:26.077280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 805/1578] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:26.130915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:26.131531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:26.137930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:26.138384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:26.139148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:26.139592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:26.201082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:26.208915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b904b6b9-1a6a-4c69-afe0-eada6237586d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081790 Mar 08 20:09:26.209509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 774/1579] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:26 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:27.088173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-28214cda-b9ee-4b51-86c1-25544e9495b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:27.089120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-28214cda-b9ee-4b51-86c1-25544e9495b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:27.095363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28214cda-b9ee-4b51-86c1-25544e9495b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:27.095819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28214cda-b9ee-4b51-86c1-25544e9495b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:27.096620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28214cda-b9ee-4b51-86c1-25544e9495b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:27.097062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28214cda-b9ee-4b51-86c1-25544e9495b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:27.125154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-28214cda-b9ee-4b51-86c1-25544e9495b9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040840 Mar 08 20:09:27.125708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 806/1580] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:27.226270 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:27.226875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:27.233121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:27.233576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:27.234336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:27.234771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:27.293458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:27.301086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8592a97c-52fa-4ab2-8a7f-5d1fe1a0c71e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078686 Mar 08 20:09:27.301650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 775/1581] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:27 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:28.136817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2205099b-11cf-4b2b-a4f3-755417b8d33f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:28.137757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2205099b-11cf-4b2b-a4f3-755417b8d33f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:28.144008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2205099b-11cf-4b2b-a4f3-755417b8d33f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:28.144497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2205099b-11cf-4b2b-a4f3-755417b8d33f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:28.145321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2205099b-11cf-4b2b-a4f3-755417b8d33f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:28.145758 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2205099b-11cf-4b2b-a4f3-755417b8d33f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:28.174070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2205099b-11cf-4b2b-a4f3-755417b8d33f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 Mar 08 20:09:28.174608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 807/1582] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:28.317796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:28.318400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:28.325085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:28.325537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:28.326318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:28.326773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:28.385881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:28.393413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a951b6d9-8e69-4468-bc05-b926ea3fb9df tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079419 Mar 08 20:09:28.393968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 776/1583] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:28 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:29.186079 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f1592bce-d662-4dbc-886a-348f7fe23467 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:29.186994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f1592bce-d662-4dbc-886a-348f7fe23467 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:29.193239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1592bce-d662-4dbc-886a-348f7fe23467 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:29.193689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1592bce-d662-4dbc-886a-348f7fe23467 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:29.194455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1592bce-d662-4dbc-886a-348f7fe23467 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:29.194896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1592bce-d662-4dbc-886a-348f7fe23467 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:29.222781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f1592bce-d662-4dbc-886a-348f7fe23467 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041135 Mar 08 20:09:29.223322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 808/1584] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:29.411452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:29.412047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:29.418552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:29.418999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:29.419759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:29.420195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:29.478149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:29.485892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c1997298-3659-4b83-9954-7ff42edce748 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078712 Mar 08 20:09:29.486460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 777/1585] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:29 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:30.234884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-db26daf0-1e9d-468f-b6e2-622c4c2cf65f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:30.235786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-db26daf0-1e9d-468f-b6e2-622c4c2cf65f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:30.242652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db26daf0-1e9d-468f-b6e2-622c4c2cf65f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:30.243095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db26daf0-1e9d-468f-b6e2-622c4c2cf65f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:30.243856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db26daf0-1e9d-468f-b6e2-622c4c2cf65f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:30.244282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db26daf0-1e9d-468f-b6e2-622c4c2cf65f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:30.271185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-db26daf0-1e9d-468f-b6e2-622c4c2cf65f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040400 Mar 08 20:09:30.271721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 809/1586] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:30.503138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:30.503696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:30.509909 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:30.510840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:30.511593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:30.512019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:30.569327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:30.577348 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-89ddef95-9910-4b6c-940e-bc931395abb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078157 Mar 08 20:09:30.577901 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 778/1587] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:30 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:31.282113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4cfb0962-f57f-4ebb-8acb-792f6d8c7c5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:31.283019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4cfb0962-f57f-4ebb-8acb-792f6d8c7c5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:31.289308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4cfb0962-f57f-4ebb-8acb-792f6d8c7c5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:31.289743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4cfb0962-f57f-4ebb-8acb-792f6d8c7c5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:31.290515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4cfb0962-f57f-4ebb-8acb-792f6d8c7c5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:31.290950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4cfb0962-f57f-4ebb-8acb-792f6d8c7c5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:31.319367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4cfb0962-f57f-4ebb-8acb-792f6d8c7c5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Mar 08 20:09:31.319913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 810/1588] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:31.593458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:31.594074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:31.600371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:31.600823 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:31.601594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:31.602030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:31.663234 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:31.670994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-30c23b0d-1a4c-4b2d-8c12-0ab9568ab067 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081365 Mar 08 20:09:31.671558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 779/1589] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:31 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:32.330588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d3078fd6-9a34-42e9-b290-f8ffefdc4114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:32.331522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d3078fd6-9a34-42e9-b290-f8ffefdc4114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:32.337746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3078fd6-9a34-42e9-b290-f8ffefdc4114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:32.338187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3078fd6-9a34-42e9-b290-f8ffefdc4114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:32.338941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3078fd6-9a34-42e9-b290-f8ffefdc4114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:32.339373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d3078fd6-9a34-42e9-b290-f8ffefdc4114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:32.366230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d3078fd6-9a34-42e9-b290-f8ffefdc4114 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039453 Mar 08 20:09:32.366703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 811/1590] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:32.688473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:32.689016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:32.695215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:32.695661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:32.696578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:32.697020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:32.759478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:32.767357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eb7604e4-0109-4bca-bb11-131c6b1569cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.082845 Mar 08 20:09:32.767916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 780/1591] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:32 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:33.378090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5e73cc1c-31b6-45b4-bae6-bfff7e71d2e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:33.378932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5e73cc1c-31b6-45b4-bae6-bfff7e71d2e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:33.385258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e73cc1c-31b6-45b4-bae6-bfff7e71d2e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:33.385708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e73cc1c-31b6-45b4-bae6-bfff7e71d2e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:33.386475 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e73cc1c-31b6-45b4-bae6-bfff7e71d2e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:33.386914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e73cc1c-31b6-45b4-bae6-bfff7e71d2e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:33.415334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5e73cc1c-31b6-45b4-bae6-bfff7e71d2e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Mar 08 20:09:33.415864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 812/1592] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:33.784258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:33.784839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:33.790946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:33.791391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:33.792142 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:33.792595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:33.850190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:33.860116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-682dd2d6-ffd1-428b-84a5-d21a10ee3ea1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079475 Mar 08 20:09:33.860938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 781/1593] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:33 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:34.427112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a64b9a02-e224-4ea3-879f-5667bf1d3e85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:34.427957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a64b9a02-e224-4ea3-879f-5667bf1d3e85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:34.434227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a64b9a02-e224-4ea3-879f-5667bf1d3e85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:34.434683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a64b9a02-e224-4ea3-879f-5667bf1d3e85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:34.435447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a64b9a02-e224-4ea3-879f-5667bf1d3e85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:34.435884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a64b9a02-e224-4ea3-879f-5667bf1d3e85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:34.462958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a64b9a02-e224-4ea3-879f-5667bf1d3e85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039906 Mar 08 20:09:34.464034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 813/1594] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:34.878405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:34.879018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:34.885778 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:34.886228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:34.886995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:34.887433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:34.945253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:34.953341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5d3f75d5-1580-45da-94d0-b708b19a709e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078752 Mar 08 20:09:34.953904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 782/1595] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:34 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:35.474548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dd353130-ff6f-4bc8-a1ab-49561de2e9ee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:35.475380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dd353130-ff6f-4bc8-a1ab-49561de2e9ee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:35.481785 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd353130-ff6f-4bc8-a1ab-49561de2e9ee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:35.482242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd353130-ff6f-4bc8-a1ab-49561de2e9ee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:35.483040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd353130-ff6f-4bc8-a1ab-49561de2e9ee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:35.483487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dd353130-ff6f-4bc8-a1ab-49561de2e9ee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:35.516674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dd353130-ff6f-4bc8-a1ab-49561de2e9ee tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046102 Mar 08 20:09:35.517427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 814/1596] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:35.969546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:35.970159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:35.976461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:35.976913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:35.977680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:35.978117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:36.036058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:36.043714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9a868f74-fe9c-459c-be87-f364bd97b65b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078135 Mar 08 20:09:36.044275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 783/1597] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:35 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:36.528366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d79a0c55-e2fe-4e08-b007-5cf3cb0c3829 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:36.529276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d79a0c55-e2fe-4e08-b007-5cf3cb0c3829 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:36.535433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d79a0c55-e2fe-4e08-b007-5cf3cb0c3829 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:36.535872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d79a0c55-e2fe-4e08-b007-5cf3cb0c3829 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:36.536645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d79a0c55-e2fe-4e08-b007-5cf3cb0c3829 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:36.537076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d79a0c55-e2fe-4e08-b007-5cf3cb0c3829 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:36.563971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d79a0c55-e2fe-4e08-b007-5cf3cb0c3829 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040597 Mar 08 20:09:36.564548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 815/1598] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:37.061480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:37.062096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:37.068164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:37.068650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:37.069457 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:37.069897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:37.156314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:37.164299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2b9b7e2d-a4e3-438c-9c73-df666082865a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.107115 Mar 08 20:09:37.164897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 784/1599] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:37 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:37.575109 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8a2f91ba-1ed5-4352-8528-1d698aa10ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:37.576023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8a2f91ba-1ed5-4352-8528-1d698aa10ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:37.582250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8a2f91ba-1ed5-4352-8528-1d698aa10ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:37.582700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8a2f91ba-1ed5-4352-8528-1d698aa10ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:37.583469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8a2f91ba-1ed5-4352-8528-1d698aa10ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:37.583912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8a2f91ba-1ed5-4352-8528-1d698aa10ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:37.612769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8a2f91ba-1ed5-4352-8528-1d698aa10ed3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Mar 08 20:09:37.613324 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 816/1600] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:38.181517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:38.182295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:38.188545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:38.188995 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:38.189754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:38.190189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:38.248655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:38.256313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c7442202-7676-42dc-bd05-43a28b345295 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078629 Mar 08 20:09:38.256868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 785/1601] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:38 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:38.624259 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4e381bd8-48d2-4766-8c11-fd9046e16b0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:38.625198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4e381bd8-48d2-4766-8c11-fd9046e16b0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:38.631409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e381bd8-48d2-4766-8c11-fd9046e16b0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:38.631857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e381bd8-48d2-4766-8c11-fd9046e16b0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:38.632644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e381bd8-48d2-4766-8c11-fd9046e16b0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:38.633080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e381bd8-48d2-4766-8c11-fd9046e16b0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:38.661518 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4e381bd8-48d2-4766-8c11-fd9046e16b0c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041202 Mar 08 20:09:38.662048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 817/1602] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:39.273491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:39.274107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:39.280880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:39.281328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:39.282097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:39.282531 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:39.346441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:39.354771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-179013a7-9c5e-4daa-b45b-2d714fb8326d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.085421 Mar 08 20:09:39.355329 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 786/1603] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:39 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:39.673553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-343b437a-c1dc-447c-bd1b-0542b864e6d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:39.674469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-343b437a-c1dc-447c-bd1b-0542b864e6d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:39.680751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343b437a-c1dc-447c-bd1b-0542b864e6d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:39.681209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343b437a-c1dc-447c-bd1b-0542b864e6d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:39.681973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343b437a-c1dc-447c-bd1b-0542b864e6d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:39.682407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-343b437a-c1dc-447c-bd1b-0542b864e6d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:39.709504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-343b437a-c1dc-447c-bd1b-0542b864e6d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039961 Mar 08 20:09:39.710050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 818/1604] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:40.373217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:40.373757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:40.379957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:40.380443 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:40.381211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:40.381651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:40.440399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:40.448021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c1c9cd90-bded-43c1-a0f5-7d71f78cef69 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079305 Mar 08 20:09:40.448626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 787/1605] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:40 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:40.721394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5f0a6d91-42ae-43ba-86e9-6ac8ddb73de2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:40.722222 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5f0a6d91-42ae-43ba-86e9-6ac8ddb73de2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:40.728524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f0a6d91-42ae-43ba-86e9-6ac8ddb73de2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:40.728975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f0a6d91-42ae-43ba-86e9-6ac8ddb73de2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:40.729736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f0a6d91-42ae-43ba-86e9-6ac8ddb73de2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:40.730170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f0a6d91-42ae-43ba-86e9-6ac8ddb73de2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:40.758091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5f0a6d91-42ae-43ba-86e9-6ac8ddb73de2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040665 Mar 08 20:09:40.758634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 819/1606] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:41.465360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:41.465865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:41.472568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:41.473025 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:41.473799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:41.474238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:41.535383 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:41.543791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-250cbea5-9ee4-4ca2-ac69-07bdb5852cb1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.082905 Mar 08 20:09:41.544379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 788/1607] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:41 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:41.770123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e554835a-536f-4b5d-b85a-227b1d8ce2db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:41.770993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e554835a-536f-4b5d-b85a-227b1d8ce2db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:41.778157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e554835a-536f-4b5d-b85a-227b1d8ce2db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:41.778765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e554835a-536f-4b5d-b85a-227b1d8ce2db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:41.779536 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e554835a-536f-4b5d-b85a-227b1d8ce2db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:41.779977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e554835a-536f-4b5d-b85a-227b1d8ce2db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:41.807169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e554835a-536f-4b5d-b85a-227b1d8ce2db tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Mar 08 20:09:41.807764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 820/1608] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:42.561409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:42.561981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:42.568221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:42.568707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:42.569474 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:42.569914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:42.628388 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:42.636349 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-625e7fee-3341-49d7-8508-e4d1ff376c6d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079414 Mar 08 20:09:42.636930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 789/1609] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:42 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:42.818772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d1c43cdb-b532-4748-89ac-8dfe4eea4969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:42.819681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d1c43cdb-b532-4748-89ac-8dfe4eea4969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:42.826016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c43cdb-b532-4748-89ac-8dfe4eea4969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:42.826461 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c43cdb-b532-4748-89ac-8dfe4eea4969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:42.827220 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c43cdb-b532-4748-89ac-8dfe4eea4969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:42.827650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d1c43cdb-b532-4748-89ac-8dfe4eea4969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:42.855742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d1c43cdb-b532-4748-89ac-8dfe4eea4969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040948 Mar 08 20:09:42.856280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 821/1610] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:43.653445 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:43.654031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:43.660371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:43.660721 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:43.661502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:43.661932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:43.722964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:43.730628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f6e9354b-e81f-4174-89a5-17050d62f0ed tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081048 Mar 08 20:09:43.731180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 790/1611] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:43 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:43.867545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3e245aef-a728-417f-a524-2af3287e8d91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:43.868537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3e245aef-a728-417f-a524-2af3287e8d91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:43.875419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e245aef-a728-417f-a524-2af3287e8d91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:43.875873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e245aef-a728-417f-a524-2af3287e8d91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:43.876675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e245aef-a728-417f-a524-2af3287e8d91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:43.877118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3e245aef-a728-417f-a524-2af3287e8d91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:43.906401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3e245aef-a728-417f-a524-2af3287e8d91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042788 Mar 08 20:09:43.906966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 822/1612] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:44.746480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:44.747070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:44.753342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:44.753792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:44.754551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:44.754987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:44.819563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:44.827371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b1251967-c971-43ba-b514-107ae2d3d49f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.084808 Mar 08 20:09:44.827927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 791/1613] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:44 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:44.919036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-be8099ba-d49d-40b3-a65b-09f257c37ed1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:44.919980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-be8099ba-d49d-40b3-a65b-09f257c37ed1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:44.926288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be8099ba-d49d-40b3-a65b-09f257c37ed1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:44.926739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be8099ba-d49d-40b3-a65b-09f257c37ed1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:44.927507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be8099ba-d49d-40b3-a65b-09f257c37ed1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:44.927943 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-be8099ba-d49d-40b3-a65b-09f257c37ed1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:44.955508 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-be8099ba-d49d-40b3-a65b-09f257c37ed1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Mar 08 20:09:44.956049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 823/1614] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:45.844665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:45.845271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:45.851464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:45.851906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:45.852686 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:45.853117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:45.913583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:45.921223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2f4e135f-a62f-4572-9cd0-55fab610f317 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080415 Mar 08 20:09:45.921789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 792/1615] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:45 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:45.966858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2fe91eea-8361-4172-aa1e-30fbed561523 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:45.967756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2fe91eea-8361-4172-aa1e-30fbed561523 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:45.974445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fe91eea-8361-4172-aa1e-30fbed561523 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:45.974887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fe91eea-8361-4172-aa1e-30fbed561523 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:45.975643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fe91eea-8361-4172-aa1e-30fbed561523 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:45.976073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2fe91eea-8361-4172-aa1e-30fbed561523 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:46.002861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2fe91eea-8361-4172-aa1e-30fbed561523 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039974 Mar 08 20:09:46.003390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 824/1616] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:46.938208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:46.938817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:46.945072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:46.945527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:46.946309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:46.946726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:47.003989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:47.012348 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-02a6cae6-a27f-4763-9274-3b8fc530e1be tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078032 Mar 08 20:09:47.012908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 793/1617] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:46 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:47.014269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-86937e0f-efb2-41e1-89a8-6d2dc81c7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:47.015181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-86937e0f-efb2-41e1-89a8-6d2dc81c7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:47.021500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86937e0f-efb2-41e1-89a8-6d2dc81c7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:47.021893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86937e0f-efb2-41e1-89a8-6d2dc81c7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:47.022655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86937e0f-efb2-41e1-89a8-6d2dc81c7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:47.023360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86937e0f-efb2-41e1-89a8-6d2dc81c7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:47.050439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-86937e0f-efb2-41e1-89a8-6d2dc81c7834 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040751 Mar 08 20:09:47.050973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 825/1618] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:09:48.028755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:48.029350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:48.035552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:48.035999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:48.036781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:48.037213 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:48.061686 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7b007fa6-80ae-4c61-978d-1cd682599f90 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:48.062603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7b007fa6-80ae-4c61-978d-1cd682599f90 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:48.068873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b007fa6-80ae-4c61-978d-1cd682599f90 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:48.069329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b007fa6-80ae-4c61-978d-1cd682599f90 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:48.070103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b007fa6-80ae-4c61-978d-1cd682599f90 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:48.070540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7b007fa6-80ae-4c61-978d-1cd682599f90 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:48.095894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:48.098690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7b007fa6-80ae-4c61-978d-1cd682599f90 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Mar 08 20:09:48.099260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 826/1619] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:09:48.104525 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a2354a62-6ca4-44e2-8bb5-4c43dd203273 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079085 Mar 08 20:09:48.105089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 794/1620] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:48 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:49.110721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e3d0c4f5-cae1-4eae-a666-ce8af6fd062a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:49.111642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e3d0c4f5-cae1-4eae-a666-ce8af6fd062a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:49.118009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d0c4f5-cae1-4eae-a666-ce8af6fd062a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:49.118464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d0c4f5-cae1-4eae-a666-ce8af6fd062a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:49.119241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d0c4f5-cae1-4eae-a666-ce8af6fd062a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:49.119678 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3d0c4f5-cae1-4eae-a666-ce8af6fd062a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:49.121354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:49.121969 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:49.128156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:49.128822 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:49.129629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:49.130074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:49.147648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e3d0c4f5-cae1-4eae-a666-ce8af6fd062a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040867 Mar 08 20:09:49.148506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 827/1621] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:49.189753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:49.197527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2b15414-1abd-4788-969c-dee9c141ede5 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080309 Mar 08 20:09:49.198087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 795/1622] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:49 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:09:50.160177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b06452ad-2784-4b64-978d-33f9c4db31cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:50.173249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b06452ad-2784-4b64-978d-33f9c4db31cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:50.173249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b06452ad-2784-4b64-978d-33f9c4db31cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:50.173249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b06452ad-2784-4b64-978d-33f9c4db31cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:50.173249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b06452ad-2784-4b64-978d-33f9c4db31cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:50.173670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b06452ad-2784-4b64-978d-33f9c4db31cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:50.200409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b06452ad-2784-4b64-978d-33f9c4db31cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Mar 08 20:09:50.200970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 828/1623] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:50.214855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:50.215470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:50.221726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:50.222172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:50.222951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:50.223384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:50.286303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:50.294603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e8026da8-5cae-4e8c-9689-0caf0f418de9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.084182 Mar 08 20:09:50.295164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 796/1624] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:50 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:51.211734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-889a28b6-be1a-4f72-bf43-50b699fac4c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:51.212676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-889a28b6-be1a-4f72-bf43-50b699fac4c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:51.218633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-889a28b6-be1a-4f72-bf43-50b699fac4c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:51.219083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-889a28b6-be1a-4f72-bf43-50b699fac4c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:51.219839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-889a28b6-be1a-4f72-bf43-50b699fac4c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:51.220270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-889a28b6-be1a-4f72-bf43-50b699fac4c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:51.248173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-889a28b6-be1a-4f72-bf43-50b699fac4c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040367 Mar 08 20:09:51.248739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 829/1625] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:51.311928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:51.312554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:51.318701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:51.319141 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:51.319894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:51.320345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:51.377622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:51.385370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-25f43f3b-89c9-4fe5-9cc6-f7ae08ac412f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.077314 Mar 08 20:09:51.385940 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 797/1626] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:51 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:52.260806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-65980f69-e2c8-4333-a7f5-d53d14324abd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:52.261722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-65980f69-e2c8-4333-a7f5-d53d14324abd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:52.267982 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65980f69-e2c8-4333-a7f5-d53d14324abd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:52.268471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65980f69-e2c8-4333-a7f5-d53d14324abd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:52.269242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65980f69-e2c8-4333-a7f5-d53d14324abd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:52.269682 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65980f69-e2c8-4333-a7f5-d53d14324abd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:52.297662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-65980f69-e2c8-4333-a7f5-d53d14324abd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041423 Mar 08 20:09:52.298210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 830/1627] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:52.402191 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:52.402716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:52.409016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:52.409463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:52.410223 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:52.410660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:52.468520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:52.476128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-138aa272-47ba-4747-978e-0ade485949a8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078084 Mar 08 20:09:52.476708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 798/1628] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:52 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:53.309026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4ddab064-4588-4fbb-8ddd-f463f99b3c91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:53.309934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4ddab064-4588-4fbb-8ddd-f463f99b3c91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:53.316127 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddab064-4588-4fbb-8ddd-f463f99b3c91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:53.316599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddab064-4588-4fbb-8ddd-f463f99b3c91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:53.317358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddab064-4588-4fbb-8ddd-f463f99b3c91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:53.317804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddab064-4588-4fbb-8ddd-f463f99b3c91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:53.346371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4ddab064-4588-4fbb-8ddd-f463f99b3c91 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041234 Mar 08 20:09:53.346915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 831/1629] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:53.493337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:53.493871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:53.500083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:53.500573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:53.501354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:53.501793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:53.561812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:53.571075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8bc8f202-ce86-4ac9-810f-5ac9dddf1bc7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081719 Mar 08 20:09:53.571644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 799/1630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:53 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:54.358392 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d666df41-2a08-4a7a-a952-18de4ec6e60c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:54.359334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d666df41-2a08-4a7a-a952-18de4ec6e60c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:54.365679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d666df41-2a08-4a7a-a952-18de4ec6e60c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:54.366075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d666df41-2a08-4a7a-a952-18de4ec6e60c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:54.366843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d666df41-2a08-4a7a-a952-18de4ec6e60c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:54.367282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d666df41-2a08-4a7a-a952-18de4ec6e60c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:54.394549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d666df41-2a08-4a7a-a952-18de4ec6e60c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040639 Mar 08 20:09:54.395099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 832/1631] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:54.588548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:54.589185 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:54.595674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:54.596102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:54.596896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:54.597330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:54.656112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:54.663775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f3a5bfec-fa76-401f-8d09-1d6cb3658e58 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079271 Mar 08 20:09:54.664358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 800/1632] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:54 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:55.406339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ca047050-6305-4e2c-8ca7-fbcb416d9c7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:55.407170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ca047050-6305-4e2c-8ca7-fbcb416d9c7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:55.413398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca047050-6305-4e2c-8ca7-fbcb416d9c7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:55.413851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca047050-6305-4e2c-8ca7-fbcb416d9c7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:55.414624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca047050-6305-4e2c-8ca7-fbcb416d9c7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:55.415062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca047050-6305-4e2c-8ca7-fbcb416d9c7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:55.442742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ca047050-6305-4e2c-8ca7-fbcb416d9c7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040432 Mar 08 20:09:55.443281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 833/1633] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:55.681164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:55.681782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:55.688597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:55.689049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:55.689817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:55.690254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:55.748273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:55.755883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f4e79aa7-ed56-4262-9acf-9c3e49773321 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078734 Mar 08 20:09:55.756471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 801/1634] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:55 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:56.454339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dbebe4ca-e13c-476d-b8ae-1c08bae3bacf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:56.455170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dbebe4ca-e13c-476d-b8ae-1c08bae3bacf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:56.461411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbebe4ca-e13c-476d-b8ae-1c08bae3bacf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:56.461859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbebe4ca-e13c-476d-b8ae-1c08bae3bacf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:56.462624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbebe4ca-e13c-476d-b8ae-1c08bae3bacf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:56.463058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dbebe4ca-e13c-476d-b8ae-1c08bae3bacf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:56.491086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dbebe4ca-e13c-476d-b8ae-1c08bae3bacf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Mar 08 20:09:56.491638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 834/1635] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:56.773190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:56.773739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:56.779999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:56.780489 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:56.781275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:56.781692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:56.842784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:56.850464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d787956d-090a-42da-89c3-04f65cc4891d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081508 Mar 08 20:09:56.851023 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 802/1636] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:56 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:57.503277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-db925f8c-71c0-44cc-bbcf-bb86ba0b7398 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:57.504153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-db925f8c-71c0-44cc-bbcf-bb86ba0b7398 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:57.510468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db925f8c-71c0-44cc-bbcf-bb86ba0b7398 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:57.510950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db925f8c-71c0-44cc-bbcf-bb86ba0b7398 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:57.511716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db925f8c-71c0-44cc-bbcf-bb86ba0b7398 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:57.512155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-db925f8c-71c0-44cc-bbcf-bb86ba0b7398 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:57.540468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-db925f8c-71c0-44cc-bbcf-bb86ba0b7398 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Mar 08 20:09:57.541010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 835/1637] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:57.866757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:57.867357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:57.873594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:57.874036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:57.874884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:57.875315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:57.932921 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:57.940524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d40da34d-6296-4143-963f-25d2df5c9f14 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.077535 Mar 08 20:09:57.941073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 803/1638] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:57 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:58.552361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-637617b5-a3cf-4dee-b8c6-e0d005dc2b3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:58.553263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-637617b5-a3cf-4dee-b8c6-e0d005dc2b3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:58.559408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-637617b5-a3cf-4dee-b8c6-e0d005dc2b3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:58.559849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-637617b5-a3cf-4dee-b8c6-e0d005dc2b3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:58.560627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-637617b5-a3cf-4dee-b8c6-e0d005dc2b3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:58.561056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-637617b5-a3cf-4dee-b8c6-e0d005dc2b3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:58.589547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-637617b5-a3cf-4dee-b8c6-e0d005dc2b3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041133 Mar 08 20:09:58.590083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 836/1639] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:09:58.957509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:58.958127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:58.964908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:58.965363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:58.966132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:58.966570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:59.024276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:09:59.032510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-694bcee0-bb87-4d69-8c3b-f5c2155dd20f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078759 Mar 08 20:09:59.033019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 804/1640] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:09:58 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:09:59.601564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9839e289-4b26-4586-9449-fec1b3d817fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:09:59.602501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9839e289-4b26-4586-9449-fec1b3d817fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:09:59.610826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9839e289-4b26-4586-9449-fec1b3d817fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:59.611689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9839e289-4b26-4586-9449-fec1b3d817fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:59.612973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9839e289-4b26-4586-9449-fec1b3d817fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:09:59.613808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9839e289-4b26-4586-9449-fec1b3d817fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:09:59.644363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9839e289-4b26-4586-9449-fec1b3d817fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Mar 08 20:09:59.644916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 837/1641] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:09:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:00.052321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:00.052887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:00.060103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:00.060588 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:00.061352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:00.061788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:00.122591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:00.130239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8652732d-2416-4531-b9f5-6ce564bfeec3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.082902 Mar 08 20:10:00.130795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 805/1642] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:00 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:00.656589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-07ec8566-9993-4b16-bfe6-72153ae158ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:00.657497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-07ec8566-9993-4b16-bfe6-72153ae158ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:00.663700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07ec8566-9993-4b16-bfe6-72153ae158ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:00.664150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07ec8566-9993-4b16-bfe6-72153ae158ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:00.664951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07ec8566-9993-4b16-bfe6-72153ae158ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:00.665384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-07ec8566-9993-4b16-bfe6-72153ae158ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:00.693494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-07ec8566-9993-4b16-bfe6-72153ae158ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040914 Mar 08 20:10:00.694029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 838/1643] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:01.148111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:01.148719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:01.156206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:01.156674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:01.157432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:01.157858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:01.218533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:01.226278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-802b3e56-69e1-4608-8d33-2b823d055b84 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.082160 Mar 08 20:10:01.226844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 806/1644] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:01 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:01.704845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-48429d0a-9ebb-4b64-ad0b-7daae61ebdde tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:01.705754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-48429d0a-9ebb-4b64-ad0b-7daae61ebdde tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:01.711952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48429d0a-9ebb-4b64-ad0b-7daae61ebdde tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:01.712443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48429d0a-9ebb-4b64-ad0b-7daae61ebdde tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:01.713847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48429d0a-9ebb-4b64-ad0b-7daae61ebdde tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:01.714277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-48429d0a-9ebb-4b64-ad0b-7daae61ebdde tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:01.741110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-48429d0a-9ebb-4b64-ad0b-7daae61ebdde tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040227 Mar 08 20:10:01.741643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 839/1645] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:02.242971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:02.243581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:02.250376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:02.250820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:02.251583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:02.252018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:02.310368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:02.317955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-10ca252a-261a-4a39-8938-d2026b3d6caf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078902 Mar 08 20:10:02.318510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 807/1646] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:02 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:02.752872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b6dda70d-a701-4a85-82db-da5baef1fce9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:02.753724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b6dda70d-a701-4a85-82db-da5baef1fce9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:02.760559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6dda70d-a701-4a85-82db-da5baef1fce9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:02.761012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6dda70d-a701-4a85-82db-da5baef1fce9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:02.761773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6dda70d-a701-4a85-82db-da5baef1fce9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:02.762206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b6dda70d-a701-4a85-82db-da5baef1fce9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:02.790373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b6dda70d-a701-4a85-82db-da5baef1fce9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041449 Mar 08 20:10:02.790955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 840/1647] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:10:03.333876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:03.334506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:03.341215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:03.341660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:03.342409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:03.342835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:03.404168 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:03.411898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9ffcf880-a9d1-44e2-8f94-cd4a99ac514e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081926 Mar 08 20:10:03.412496 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 808/1648] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:03 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:03.801861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e377b1c2-3c63-4175-b415-97660ca66a7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:03.802693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e377b1c2-3c63-4175-b415-97660ca66a7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:03.808900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e377b1c2-3c63-4175-b415-97660ca66a7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:03.809351 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e377b1c2-3c63-4175-b415-97660ca66a7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:03.810112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e377b1c2-3c63-4175-b415-97660ca66a7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:03.810546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e377b1c2-3c63-4175-b415-97660ca66a7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:03.838611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e377b1c2-3c63-4175-b415-97660ca66a7c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040133 Mar 08 20:10:03.839132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 841/1649] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:04.429266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:04.429826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:04.436590 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:04.437045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:04.437812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:04.438247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:04.497232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:04.504918 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-668193d7-589d-42e8-95f3-09b50e32a375 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079586 Mar 08 20:10:04.505479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 809/1650] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:04 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:04.849041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cfcbf837-4aa2-4245-9aea-9fc623100cbf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:04.849973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cfcbf837-4aa2-4245-9aea-9fc623100cbf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:04.856747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfcbf837-4aa2-4245-9aea-9fc623100cbf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:04.857196 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfcbf837-4aa2-4245-9aea-9fc623100cbf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:04.857956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfcbf837-4aa2-4245-9aea-9fc623100cbf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:04.858389 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfcbf837-4aa2-4245-9aea-9fc623100cbf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:04.885300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cfcbf837-4aa2-4245-9aea-9fc623100cbf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040200 Mar 08 20:10:04.885830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 842/1651] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:05.521541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:05.522070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:05.529107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:05.529550 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:05.530305 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:05.530732 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:05.588388 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:05.595949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eeefd79b-2c2e-40c1-b8cf-e12e05b8eee7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078311 Mar 08 20:10:05.596541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 810/1652] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:05 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:05.896486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-23b852af-1204-4803-8bbd-0f30ec043005 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:05.897397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-23b852af-1204-4803-8bbd-0f30ec043005 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:05.904420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23b852af-1204-4803-8bbd-0f30ec043005 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:05.904875 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23b852af-1204-4803-8bbd-0f30ec043005 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:05.905644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23b852af-1204-4803-8bbd-0f30ec043005 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:05.906080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-23b852af-1204-4803-8bbd-0f30ec043005 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:05.940368 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-23b852af-1204-4803-8bbd-0f30ec043005 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047811 Mar 08 20:10:05.940923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 843/1653] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:06.612701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:06.613320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:06.620027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:06.620514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:06.621288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:06.621756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:06.679783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:06.687976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b805b3a3-1310-4636-a01d-f11dbb96b6a3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079220 Mar 08 20:10:06.688575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 811/1654] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:06 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:06.951865 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-80b6a1ff-7f29-4fca-8e4e-8dc29df5a724 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:06.952739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-80b6a1ff-7f29-4fca-8e4e-8dc29df5a724 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:06.958914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80b6a1ff-7f29-4fca-8e4e-8dc29df5a724 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:06.959362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80b6a1ff-7f29-4fca-8e4e-8dc29df5a724 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:06.960117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80b6a1ff-7f29-4fca-8e4e-8dc29df5a724 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:06.960586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80b6a1ff-7f29-4fca-8e4e-8dc29df5a724 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:06.987921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-80b6a1ff-7f29-4fca-8e4e-8dc29df5a724 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040102 Mar 08 20:10:06.988485 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 844/1655] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:07.705393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:07.706020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:07.712188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:07.712663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:07.713422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:07.713863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:07.773513 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:07.781153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8390afce-8c96-4928-afc5-0dc57bde0efc tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079636 Mar 08 20:10:07.781714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 812/1656] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:07 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:07.999966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3d53761e-3813-40da-a86f-e02d76328f3c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:08.000811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3d53761e-3813-40da-a86f-e02d76328f3c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:08.006971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3d53761e-3813-40da-a86f-e02d76328f3c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:08.007411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3d53761e-3813-40da-a86f-e02d76328f3c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:08.008165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3d53761e-3813-40da-a86f-e02d76328f3c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:08.008627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3d53761e-3813-40da-a86f-e02d76328f3c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:08.036501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3d53761e-3813-40da-a86f-e02d76328f3c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 Mar 08 20:10:08.037026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 845/1657] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:08.797637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:08.798241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:08.804679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:08.805163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:08.805931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:08.806917 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:08.864569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:08.872662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cee27949-3eab-42ee-9306-c9b1795b6ecf tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078817 Mar 08 20:10:08.873264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 813/1658] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:08 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:09.047904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2ec656a9-7497-4569-967f-c9904a4bfdbb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:09.048754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2ec656a9-7497-4569-967f-c9904a4bfdbb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:09.054881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ec656a9-7497-4569-967f-c9904a4bfdbb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:09.055303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ec656a9-7497-4569-967f-c9904a4bfdbb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:09.056053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ec656a9-7497-4569-967f-c9904a4bfdbb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:09.056520 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2ec656a9-7497-4569-967f-c9904a4bfdbb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:09.084051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2ec656a9-7497-4569-967f-c9904a4bfdbb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040220 Mar 08 20:10:09.084611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 846/1659] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:09.889215 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:09.889821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:09.896094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:09.896571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:09.897330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:09.898054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:09.959086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:09.966764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-86c5125e-f4fa-4ebb-aba3-2d32c8d96677 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081394 Mar 08 20:10:09.967324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 814/1660] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:09 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:10.096033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-27d33f88-51a0-43f4-af39-3b2d93cd309f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:10.096978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-27d33f88-51a0-43f4-af39-3b2d93cd309f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:10.103918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27d33f88-51a0-43f4-af39-3b2d93cd309f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:10.104525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27d33f88-51a0-43f4-af39-3b2d93cd309f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:10.105296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27d33f88-51a0-43f4-af39-3b2d93cd309f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:10.105759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-27d33f88-51a0-43f4-af39-3b2d93cd309f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:10.135792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-27d33f88-51a0-43f4-af39-3b2d93cd309f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Mar 08 20:10:10.136344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 847/1661] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:10.988238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:10.988870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:10.995156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:10.995612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:10.996415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:10.996857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:11.054692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:11.062691 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e4f16540-b40e-4de6-9fca-7b6d9a832907 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078348 Mar 08 20:10:11.063249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 815/1662] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:10 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:11.147102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9382d88b-ae36-4d8a-b792-8582a1b587c1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:11.148416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9382d88b-ae36-4d8a-b792-8582a1b587c1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:11.154619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9382d88b-ae36-4d8a-b792-8582a1b587c1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:11.155062 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9382d88b-ae36-4d8a-b792-8582a1b587c1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:11.155872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9382d88b-ae36-4d8a-b792-8582a1b587c1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:11.156424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9382d88b-ae36-4d8a-b792-8582a1b587c1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:11.185109 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9382d88b-ae36-4d8a-b792-8582a1b587c1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041901 Mar 08 20:10:11.185666 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 848/1663] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:12.079464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:12.080083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:12.086372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:12.086817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:12.087609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:12.088046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:12.149495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:12.157494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8bec02e4-08d8-417c-8891-f7db7fccec8f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081934 Mar 08 20:10:12.158053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 816/1664] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:12 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:12.196502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7ce1344c-7284-4e56-aada-ecebf5f741ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:12.197415 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7ce1344c-7284-4e56-aada-ecebf5f741ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:12.203625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ce1344c-7284-4e56-aada-ecebf5f741ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:12.204074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ce1344c-7284-4e56-aada-ecebf5f741ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:12.204893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ce1344c-7284-4e56-aada-ecebf5f741ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:12.205333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7ce1344c-7284-4e56-aada-ecebf5f741ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:12.232917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7ce1344c-7284-4e56-aada-ecebf5f741ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040406 Mar 08 20:10:12.233463 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 849/1665] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:13.174815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:13.175459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:13.182259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:13.182707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:13.183475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:13.183914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:13.241490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:13.246302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e3e5c503-2167-408d-916e-2166d749160f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:13.247205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e3e5c503-2167-408d-916e-2166d749160f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:13.250322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-31ab0f6f-15bc-415d-8f94-262eb17ac25f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078948 Mar 08 20:10:13.256996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 817/1666] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:13 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:13.257162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3e5c503-2167-408d-916e-2166d749160f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:13.257162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3e5c503-2167-408d-916e-2166d749160f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:13.257162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3e5c503-2167-408d-916e-2166d749160f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:13.257162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e3e5c503-2167-408d-916e-2166d749160f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:13.283289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e3e5c503-2167-408d-916e-2166d749160f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Mar 08 20:10:13.283820 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 850/1667] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:10:14.267173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:14.267782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:14.274410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:14.274865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:14.275634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:14.276073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:14.294985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f9bd61d9-d7f0-482b-aca7-ab669bbda4e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:14.295889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f9bd61d9-d7f0-482b-aca7-ab669bbda4e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:14.302072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bd61d9-d7f0-482b-aca7-ab669bbda4e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:14.302522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bd61d9-d7f0-482b-aca7-ab669bbda4e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:14.303291 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bd61d9-d7f0-482b-aca7-ab669bbda4e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:14.303726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bd61d9-d7f0-482b-aca7-ab669bbda4e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:14.333230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f9bd61d9-d7f0-482b-aca7-ab669bbda4e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042570 Mar 08 20:10:14.334298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 851/1668] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:10:14.336405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:14.344010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c27f5fc6-ccf7-4e51-819d-ba132561744b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080638 Mar 08 20:10:14.344610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 818/1669] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:14 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:15.344709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c220e26-76ac-4287-af0d-7f8d1eda00e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:15.345652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4c220e26-76ac-4287-af0d-7f8d1eda00e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:15.351832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c220e26-76ac-4287-af0d-7f8d1eda00e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:15.352281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c220e26-76ac-4287-af0d-7f8d1eda00e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:15.353703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c220e26-76ac-4287-af0d-7f8d1eda00e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:15.354145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c220e26-76ac-4287-af0d-7f8d1eda00e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:15.360863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:15.361471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:15.367650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:15.368032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:15.368828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:15.369262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:15.382862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4c220e26-76ac-4287-af0d-7f8d1eda00e4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042191 Mar 08 20:10:15.383435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 852/1670] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:15.427094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:15.434788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a47ebc0a-03bf-4c39-a368-9bddfeb5a5cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.077693 Mar 08 20:10:15.435345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 819/1671] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:15 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:10:16.394667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-672db922-9ec0-4ae3-b110-2722d51b38b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:16.395527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-672db922-9ec0-4ae3-b110-2722d51b38b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:16.402076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-672db922-9ec0-4ae3-b110-2722d51b38b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:16.402529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-672db922-9ec0-4ae3-b110-2722d51b38b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:16.403296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-672db922-9ec0-4ae3-b110-2722d51b38b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:16.403731 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-672db922-9ec0-4ae3-b110-2722d51b38b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:16.431556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-672db922-9ec0-4ae3-b110-2722d51b38b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040513 Mar 08 20:10:16.432087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 853/1672] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:16.451244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:16.451874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:16.458133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:16.458574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:16.459327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:16.459754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:16.521089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:16.529211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8fd3d5d7-6758-42e7-8aae-073d13baea85 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.082272 Mar 08 20:10:16.529798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 820/1673] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:16 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:17.443073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c05f7cd3-b897-4001-a77c-50206c30d1da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:17.443898 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c05f7cd3-b897-4001-a77c-50206c30d1da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:17.450764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c05f7cd3-b897-4001-a77c-50206c30d1da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:17.451214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c05f7cd3-b897-4001-a77c-50206c30d1da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:17.451985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c05f7cd3-b897-4001-a77c-50206c30d1da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:17.452465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c05f7cd3-b897-4001-a77c-50206c30d1da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:17.480226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c05f7cd3-b897-4001-a77c-50206c30d1da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041171 Mar 08 20:10:17.480794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 854/1674] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:17.544951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:17.545552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:17.551804 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:17.552247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:17.553034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:17.553459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:17.616464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:17.624780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-919735fd-ea32-40b1-ba93-1cbff7375d4a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083487 Mar 08 20:10:17.625339 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 821/1675] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:17 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:18.491243 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-657df6d9-a009-4989-9a92-b17539d15dd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:18.492080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-657df6d9-a009-4989-9a92-b17539d15dd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:18.498356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657df6d9-a009-4989-9a92-b17539d15dd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:18.498809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657df6d9-a009-4989-9a92-b17539d15dd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:18.499578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657df6d9-a009-4989-9a92-b17539d15dd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:18.500042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657df6d9-a009-4989-9a92-b17539d15dd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:18.527893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-657df6d9-a009-4989-9a92-b17539d15dd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 Mar 08 20:10:18.528462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 855/1676] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:18.641380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:18.641986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:18.648444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:18.648893 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:18.649648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:18.650567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:18.708281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:18.716617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7014e012-9007-4242-8276-4e17f13dc878 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079005 Mar 08 20:10:18.717180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 822/1677] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:18 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:19.539350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2321fca0-4b62-41bc-b07a-de87a1bc161e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:19.540757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2321fca0-4b62-41bc-b07a-de87a1bc161e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:19.546909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2321fca0-4b62-41bc-b07a-de87a1bc161e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:19.547354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2321fca0-4b62-41bc-b07a-de87a1bc161e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:19.548105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2321fca0-4b62-41bc-b07a-de87a1bc161e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:19.548562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2321fca0-4b62-41bc-b07a-de87a1bc161e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:19.576068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2321fca0-4b62-41bc-b07a-de87a1bc161e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040652 Mar 08 20:10:19.576671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 856/1678] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:19.733629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:19.734247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:19.741428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:19.742000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:19.742982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:19.743569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:19.808136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:19.816301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a2db39fa-8ab0-4a15-a0a5-95bb57ccaa7f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.086533 Mar 08 20:10:19.816895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 823/1679] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:19 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:20.587118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f586b8d2-16d0-4592-b62e-6bdffe142527 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:20.588611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f586b8d2-16d0-4592-b62e-6bdffe142527 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:20.594583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f586b8d2-16d0-4592-b62e-6bdffe142527 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:20.595064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f586b8d2-16d0-4592-b62e-6bdffe142527 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:20.595833 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f586b8d2-16d0-4592-b62e-6bdffe142527 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:20.596273 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f586b8d2-16d0-4592-b62e-6bdffe142527 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:20.624252 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f586b8d2-16d0-4592-b62e-6bdffe142527 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041126 Mar 08 20:10:20.624820 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 857/1680] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:20.833602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:20.834200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:20.840968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:20.841355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:20.842108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:20.842536 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:20.899502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:20.907508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6c419262-34c3-4fac-a00d-ad0b6ede2084 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.077695 Mar 08 20:10:20.908054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 824/1681] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:20 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:21.635670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d9debea1-e705-46ad-9779-dfd55624bb43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:21.636630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d9debea1-e705-46ad-9779-dfd55624bb43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:21.642815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d9debea1-e705-46ad-9779-dfd55624bb43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:21.643265 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d9debea1-e705-46ad-9779-dfd55624bb43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:21.644023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d9debea1-e705-46ad-9779-dfd55624bb43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:21.644484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d9debea1-e705-46ad-9779-dfd55624bb43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:21.673061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d9debea1-e705-46ad-9779-dfd55624bb43 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Mar 08 20:10:21.673615 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 858/1682] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:21.924098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:21.924674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:21.930947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:21.931393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:21.932149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:21.932605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:21.992481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:22.000202 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0a47dcd5-84de-4815-9237-9a4da8c75889 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079998 Mar 08 20:10:22.000774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 825/1683] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:21 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:22.684443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-eebe343c-c28f-4c4e-ad1e-59b98b0ba54c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:22.685270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-eebe343c-c28f-4c4e-ad1e-59b98b0ba54c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:22.691582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eebe343c-c28f-4c4e-ad1e-59b98b0ba54c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:22.692032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eebe343c-c28f-4c4e-ad1e-59b98b0ba54c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:22.692824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eebe343c-c28f-4c4e-ad1e-59b98b0ba54c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:22.693264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eebe343c-c28f-4c4e-ad1e-59b98b0ba54c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:22.720730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-eebe343c-c28f-4c4e-ad1e-59b98b0ba54c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040836 Mar 08 20:10:22.721275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 859/1684] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:23.017687 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:23.018316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:23.025248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:23.025699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:23.026469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:23.026907 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:23.088619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:23.096471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8fb01105-995e-4674-b6d5-bfcde9ca7c5e tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.082755 Mar 08 20:10:23.097037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 826/1685] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:23 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:23.732239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cd39fce2-cde2-4491-8bc6-f66d5d36c838 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:23.733160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cd39fce2-cde2-4491-8bc6-f66d5d36c838 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:23.739444 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cd39fce2-cde2-4491-8bc6-f66d5d36c838 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:23.739887 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cd39fce2-cde2-4491-8bc6-f66d5d36c838 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:23.740675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cd39fce2-cde2-4491-8bc6-f66d5d36c838 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:23.741106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cd39fce2-cde2-4491-8bc6-f66d5d36c838 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:23.771732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cd39fce2-cde2-4491-8bc6-f66d5d36c838 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Mar 08 20:10:23.772999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 860/1686] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:24.113731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:24.114341 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:24.120615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:24.121061 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:24.121814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:24.122243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:24.180337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:24.189598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e5ad40eb-1401-4da1-b203-40ecc4810d59 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079322 Mar 08 20:10:24.190587 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 827/1687] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:24 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:24.784094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-084d58c9-74c7-45f7-a255-b3a90826df28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:24.785035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-084d58c9-74c7-45f7-a255-b3a90826df28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:24.791559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-084d58c9-74c7-45f7-a255-b3a90826df28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:24.792060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-084d58c9-74c7-45f7-a255-b3a90826df28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:24.792827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-084d58c9-74c7-45f7-a255-b3a90826df28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:24.793266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-084d58c9-74c7-45f7-a255-b3a90826df28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:24.820683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-084d58c9-74c7-45f7-a255-b3a90826df28 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040530 Mar 08 20:10:24.821217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 861/1688] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:25.206967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:25.207580 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:25.214027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:25.214635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:25.215414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:25.215855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:25.274344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:25.281962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-44051b35-4fc3-49b4-8f03-be520d01f69f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078837 Mar 08 20:10:25.282523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 828/1689] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:25 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:25.832794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-39dd9d04-70b5-4057-9544-f0ae7c9ce6c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:25.833738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-39dd9d04-70b5-4057-9544-f0ae7c9ce6c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:25.840701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39dd9d04-70b5-4057-9544-f0ae7c9ce6c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:25.841154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39dd9d04-70b5-4057-9544-f0ae7c9ce6c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:25.841922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39dd9d04-70b5-4057-9544-f0ae7c9ce6c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:25.842357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39dd9d04-70b5-4057-9544-f0ae7c9ce6c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:25.869843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-39dd9d04-70b5-4057-9544-f0ae7c9ce6c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041023 Mar 08 20:10:25.870376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 862/1690] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:26.298937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:26.299517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:26.306478 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:26.306925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:26.307681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:26.308106 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:26.364926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:26.374861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-af8f7bef-1615-4de2-9220-a2b8f5ac9c30 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079620 Mar 08 20:10:26.375711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 829/1691] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:26 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:26.881182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6eca2d93-595f-4625-a8f7-d116968d4bc8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:26.882125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6eca2d93-595f-4625-a8f7-d116968d4bc8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:26.888369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eca2d93-595f-4625-a8f7-d116968d4bc8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:26.888823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eca2d93-595f-4625-a8f7-d116968d4bc8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:26.889594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eca2d93-595f-4625-a8f7-d116968d4bc8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:26.890032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eca2d93-595f-4625-a8f7-d116968d4bc8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:26.918501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6eca2d93-595f-4625-a8f7-d116968d4bc8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041309 Mar 08 20:10:26.919039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 863/1692] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:27.397584 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:27.398109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:27.404938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:27.405390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:27.406154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:27.406589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:27.464457 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:27.472083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-12b45c11-9c6a-49dc-89b8-6db199b0ba76 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078719 Mar 08 20:10:27.472669 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 830/1693] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:27 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:27.929593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6b435598-7bfd-414a-91fa-1534cbf06f1a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:27.930544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6b435598-7bfd-414a-91fa-1534cbf06f1a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:27.936905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b435598-7bfd-414a-91fa-1534cbf06f1a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:27.937358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b435598-7bfd-414a-91fa-1534cbf06f1a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:27.938128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b435598-7bfd-414a-91fa-1534cbf06f1a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:27.938562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6b435598-7bfd-414a-91fa-1534cbf06f1a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:27.967434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6b435598-7bfd-414a-91fa-1534cbf06f1a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Mar 08 20:10:27.967974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 864/1694] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:28.489771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:28.490378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:28.496621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:28.497067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:28.497830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:28.498262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:28.559698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:28.567515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dbc2c852-3e09-4058-b683-32c809b04569 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081709 Mar 08 20:10:28.568080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 831/1695] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:28 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:28.978858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ebc90c43-c061-4f55-9122-432146600c42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:28.979789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ebc90c43-c061-4f55-9122-432146600c42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:28.985907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebc90c43-c061-4f55-9122-432146600c42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:28.986357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebc90c43-c061-4f55-9122-432146600c42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:28.987117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebc90c43-c061-4f55-9122-432146600c42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:28.987542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ebc90c43-c061-4f55-9122-432146600c42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:29.015215 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ebc90c43-c061-4f55-9122-432146600c42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040880 Mar 08 20:10:29.015770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 865/1696] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:29.585055 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:29.585652 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:29.592457 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:29.592914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:29.593677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:29.594113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:29.656941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:29.664719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4c22aee0-dfde-4334-a669-5d9782f50355 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083523 Mar 08 20:10:29.665914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 832/1697] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:29 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:10:30.027075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-15f07b15-8c01-4ac2-af9b-c6101b08f4d0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:30.027937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-15f07b15-8c01-4ac2-af9b-c6101b08f4d0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:30.034147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15f07b15-8c01-4ac2-af9b-c6101b08f4d0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:30.034596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15f07b15-8c01-4ac2-af9b-c6101b08f4d0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:30.035357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15f07b15-8c01-4ac2-af9b-c6101b08f4d0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:30.035791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15f07b15-8c01-4ac2-af9b-c6101b08f4d0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:30.062835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-15f07b15-8c01-4ac2-af9b-c6101b08f4d0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040683 Mar 08 20:10:30.063369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 866/1698] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:30.682172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:30.682779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:30.689057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:30.689501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:30.690265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:30.690702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:30.748481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:30.756017 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5d2f87c4-998d-4b0d-b14b-f9a54544b616 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.077759 Mar 08 20:10:30.756625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 833/1699] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:30 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:31.074744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d45b4a05-fad0-4b4f-9409-8fe2b0897147 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:31.075659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d45b4a05-fad0-4b4f-9409-8fe2b0897147 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:31.081908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d45b4a05-fad0-4b4f-9409-8fe2b0897147 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:31.082362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d45b4a05-fad0-4b4f-9409-8fe2b0897147 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:31.083124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d45b4a05-fad0-4b4f-9409-8fe2b0897147 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:31.083562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d45b4a05-fad0-4b4f-9409-8fe2b0897147 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:31.111837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d45b4a05-fad0-4b4f-9409-8fe2b0897147 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Mar 08 20:10:31.112681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 867/1700] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:31.773898 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:31.775099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:31.781428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:31.781874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:31.782637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:31.783068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:31.841676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:31.849366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d8a5792e-8cfc-4c85-98cd-9b11920981b6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079572 Mar 08 20:10:31.849922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 834/1701] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:31 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:32.123202 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a4c1c7d7-0392-43c2-9186-ee0aafac772e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:32.124145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a4c1c7d7-0392-43c2-9186-ee0aafac772e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:32.130434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4c1c7d7-0392-43c2-9186-ee0aafac772e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:32.130882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4c1c7d7-0392-43c2-9186-ee0aafac772e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:32.131650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4c1c7d7-0392-43c2-9186-ee0aafac772e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:32.132090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a4c1c7d7-0392-43c2-9186-ee0aafac772e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:32.160074 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a4c1c7d7-0392-43c2-9186-ee0aafac772e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Mar 08 20:10:32.160645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 868/1702] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:32.866505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:32.867143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:32.873855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:32.874304 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:32.875065 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:32.875498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:32.933862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:32.941428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c371795d-2b26-4b4b-b1b7-dc5cce09176a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078820 Mar 08 20:10:32.941986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 835/1703] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:32 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:33.171917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bfa546b1-f3b9-46a9-b0e2-2cc67daba59c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:33.172845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bfa546b1-f3b9-46a9-b0e2-2cc67daba59c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:33.179043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bfa546b1-f3b9-46a9-b0e2-2cc67daba59c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:33.179486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bfa546b1-f3b9-46a9-b0e2-2cc67daba59c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:33.180241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bfa546b1-f3b9-46a9-b0e2-2cc67daba59c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:33.181310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bfa546b1-f3b9-46a9-b0e2-2cc67daba59c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:33.208112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bfa546b1-f3b9-46a9-b0e2-2cc67daba59c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 Mar 08 20:10:33.208692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 869/1704] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:33.958661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:33.959258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:33.966169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:33.966628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:33.967397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:33.967839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:34.025933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:34.033358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-005414a5-4f06-41e0-8e69-9447f980ec9f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078596 Mar 08 20:10:34.033911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 836/1705] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:33 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:34.219143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8088bae0-82e2-45af-a33c-626fc29fb7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:34.220021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8088bae0-82e2-45af-a33c-626fc29fb7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:34.226183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8088bae0-82e2-45af-a33c-626fc29fb7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:34.226631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8088bae0-82e2-45af-a33c-626fc29fb7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:34.227382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8088bae0-82e2-45af-a33c-626fc29fb7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:34.227814 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8088bae0-82e2-45af-a33c-626fc29fb7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:34.254991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8088bae0-82e2-45af-a33c-626fc29fb7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039975 Mar 08 20:10:34.255522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 870/1706] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:35.050165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:35.050685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:35.057386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:35.057827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:35.058578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:35.059011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:35.116221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:35.124551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-772d5593-4ecc-4af0-af53-a675b79022ca tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078310 Mar 08 20:10:35.125102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 837/1707] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:35 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:35.265295 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1dd16bf0-0ef5-48a8-b1ad-b623623080f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:35.266207 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1dd16bf0-0ef5-48a8-b1ad-b623623080f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:35.272697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dd16bf0-0ef5-48a8-b1ad-b623623080f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:35.273153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dd16bf0-0ef5-48a8-b1ad-b623623080f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:35.273921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dd16bf0-0ef5-48a8-b1ad-b623623080f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:35.274364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1dd16bf0-0ef5-48a8-b1ad-b623623080f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:35.302142 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1dd16bf0-0ef5-48a8-b1ad-b623623080f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040711 Mar 08 20:10:35.302620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 871/1708] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:36.142069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:36.142679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:36.149869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:36.150326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:36.151092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:36.151527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:36.213808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:36.221686 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f90b3832-8da5-4e99-af5b-ab709cc619d6 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083572 Mar 08 20:10:36.222250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 838/1709] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:36 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:36.313893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-01030ee6-220c-4313-89c3-ea8e1ec151e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:36.314806 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-01030ee6-220c-4313-89c3-ea8e1ec151e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:36.321529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01030ee6-220c-4313-89c3-ea8e1ec151e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:36.321985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01030ee6-220c-4313-89c3-ea8e1ec151e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:36.322749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01030ee6-220c-4313-89c3-ea8e1ec151e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:36.323368 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01030ee6-220c-4313-89c3-ea8e1ec151e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:36.358919 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-01030ee6-220c-4313-89c3-ea8e1ec151e6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048922 Mar 08 20:10:36.359462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 872/1710] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:37.239997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:37.240881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:37.246438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:37.246888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:37.247658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:37.248092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:37.339500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:37.347158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1e8b2fd0-70ab-4ed3-b361-0f31b430eb9c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.111196 Mar 08 20:10:37.347720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 839/1711] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:37 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:37.370552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-43ddfb0d-b22a-481e-a099-0c0b62bb2e98 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:37.371491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-43ddfb0d-b22a-481e-a099-0c0b62bb2e98 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:37.378470 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43ddfb0d-b22a-481e-a099-0c0b62bb2e98 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:37.378922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43ddfb0d-b22a-481e-a099-0c0b62bb2e98 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:37.379699 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43ddfb0d-b22a-481e-a099-0c0b62bb2e98 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:37.380132 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-43ddfb0d-b22a-481e-a099-0c0b62bb2e98 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:37.408574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-43ddfb0d-b22a-481e-a099-0c0b62bb2e98 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042041 Mar 08 20:10:37.409134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 873/1712] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:38.364451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:38.364984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:38.371844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:38.372316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:38.373094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:38.373537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:38.419723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e7d490a2-f65c-46f2-9042-0a90cafffadc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:38.420720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e7d490a2-f65c-46f2-9042-0a90cafffadc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:38.427039 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7d490a2-f65c-46f2-9042-0a90cafffadc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:38.427514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7d490a2-f65c-46f2-9042-0a90cafffadc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:38.428299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7d490a2-f65c-46f2-9042-0a90cafffadc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:38.428741 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e7d490a2-f65c-46f2-9042-0a90cafffadc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:38.432993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:38.440815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bceff968-d687-4041-b527-eae0da6fa57c tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080282 Mar 08 20:10:38.441384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 840/1713] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:38 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:38.457425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e7d490a2-f65c-46f2-9042-0a90cafffadc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041630 Mar 08 20:10:38.457978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 874/1714] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:10:39.457646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:39.458182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:39.465042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:39.465491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:39.466265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:39.466708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:39.468684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-74fec95b-1fc7-4137-9d4d-14da997512af tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:39.469591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-74fec95b-1fc7-4137-9d4d-14da997512af tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:39.475727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74fec95b-1fc7-4137-9d4d-14da997512af tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:39.476173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74fec95b-1fc7-4137-9d4d-14da997512af tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:39.476956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74fec95b-1fc7-4137-9d4d-14da997512af tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:39.477388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-74fec95b-1fc7-4137-9d4d-14da997512af tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:39.505491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-74fec95b-1fc7-4137-9d4d-14da997512af tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040748 Mar 08 20:10:39.506045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 875/1715] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:10:39.526245 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:39.533827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-02395308-fc39-46de-86b6-4b7e58347e73 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080254 Mar 08 20:10:39.534383 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 841/1716] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:39 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:40.517457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-547f7ecd-206e-41ad-8c90-e561eb39ed2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:40.518285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-547f7ecd-206e-41ad-8c90-e561eb39ed2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:40.524915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-547f7ecd-206e-41ad-8c90-e561eb39ed2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:40.525367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-547f7ecd-206e-41ad-8c90-e561eb39ed2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:40.526137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-547f7ecd-206e-41ad-8c90-e561eb39ed2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:40.526578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-547f7ecd-206e-41ad-8c90-e561eb39ed2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:40.550517 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:40.551171 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:40.557756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-547f7ecd-206e-41ad-8c90-e561eb39ed2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Mar 08 20:10:40.558042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:40.558332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 876/1717] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:40.558486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:40.559260 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:40.559764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:40.624038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:40.632262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2666a8fb-1a12-4fda-8b31-60e0d48b6a3b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.085754 Mar 08 20:10:40.632854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 842/1718] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:40 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:10:41.569699 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5a5780c6-1237-470b-a9b1-e9d0903828a3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:41.570643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5a5780c6-1237-470b-a9b1-e9d0903828a3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:41.577331 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a5780c6-1237-470b-a9b1-e9d0903828a3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:41.577777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a5780c6-1237-470b-a9b1-e9d0903828a3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:41.578540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a5780c6-1237-470b-a9b1-e9d0903828a3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:41.578974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5a5780c6-1237-470b-a9b1-e9d0903828a3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:41.607257 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5a5780c6-1237-470b-a9b1-e9d0903828a3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Mar 08 20:10:41.607807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 877/1719] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:41.649373 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:41.650371 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:41.656731 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:41.657182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:41.657950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:41.658386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:41.715897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:41.723561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3b4fdbf7-d675-4c27-a55b-c610dd16bdef tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078469 Mar 08 20:10:41.724145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 843/1720] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:41 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:42.618821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f6d8243e-0e50-4ad9-9a74-b98db1c71497 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:42.619733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f6d8243e-0e50-4ad9-9a74-b98db1c71497 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:42.625997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f6d8243e-0e50-4ad9-9a74-b98db1c71497 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:42.626450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f6d8243e-0e50-4ad9-9a74-b98db1c71497 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:42.627209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f6d8243e-0e50-4ad9-9a74-b98db1c71497 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:42.627644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f6d8243e-0e50-4ad9-9a74-b98db1c71497 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:42.657605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f6d8243e-0e50-4ad9-9a74-b98db1c71497 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042687 Mar 08 20:10:42.658159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 878/1721] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:42.739853 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:42.740612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:42.747297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:42.747748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:42.748549 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:42.748985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:42.807104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:42.814894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f6021cf0-6545-4ad4-bf2e-0252d54ef6f1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079039 Mar 08 20:10:42.815486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 844/1722] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:42 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:43.464107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:10:43.464321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:10:43.670533 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-99a2659a-e478-4b5c-84f7-f987b32b6bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:43.671476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-99a2659a-e478-4b5c-84f7-f987b32b6bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:43.677718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99a2659a-e478-4b5c-84f7-f987b32b6bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:43.678173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99a2659a-e478-4b5c-84f7-f987b32b6bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:43.678938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99a2659a-e478-4b5c-84f7-f987b32b6bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:43.679375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-99a2659a-e478-4b5c-84f7-f987b32b6bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:43.707835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-99a2659a-e478-4b5c-84f7-f987b32b6bc4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041234 Mar 08 20:10:43.708393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 879/1723] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:43.832182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:43.832836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:43.839762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:43.840218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:43.841020 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:43.841459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:43.901040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:43.908568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-550fdc09-ac96-4b47-80ea-4471e2441101 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080192 Mar 08 20:10:43.909135 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 845/1724] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:43 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:44.718744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-eef02f38-037e-4d5c-a0a3-ce6ff46578a9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:44.719651 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-eef02f38-037e-4d5c-a0a3-ce6ff46578a9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:44.725909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eef02f38-037e-4d5c-a0a3-ce6ff46578a9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:44.726356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eef02f38-037e-4d5c-a0a3-ce6ff46578a9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:44.727143 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eef02f38-037e-4d5c-a0a3-ce6ff46578a9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:44.727577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eef02f38-037e-4d5c-a0a3-ce6ff46578a9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:44.754986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-eef02f38-037e-4d5c-a0a3-ce6ff46578a9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040165 Mar 08 20:10:44.755519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 880/1725] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:44.925775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:44.926412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:44.932685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:44.933133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:44.933896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:44.934327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:44.992384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:45.000734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0cbba664-bbc2-4ac5-85ba-5fae468793f3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078797 Mar 08 20:10:45.001300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 846/1726] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:44 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:45.767099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-29fd6f50-eb9e-48aa-b61a-c0e07ce5aba6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:45.768005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-29fd6f50-eb9e-48aa-b61a-c0e07ce5aba6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:45.775138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29fd6f50-eb9e-48aa-b61a-c0e07ce5aba6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:45.775586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29fd6f50-eb9e-48aa-b61a-c0e07ce5aba6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:45.776379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29fd6f50-eb9e-48aa-b61a-c0e07ce5aba6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:45.776817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29fd6f50-eb9e-48aa-b61a-c0e07ce5aba6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:45.804216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-29fd6f50-eb9e-48aa-b61a-c0e07ce5aba6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041010 Mar 08 20:10:45.804808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 881/1727] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:46.020425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:46.020948 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:46.028018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:46.028500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:46.029264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:46.029700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:46.087848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:46.095516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1c6fb099-f486-4a4b-a233-f7dee3c957ad tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079143 Mar 08 20:10:46.096088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 847/1728] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:46 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:46.815899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1783c4ec-e289-4eb7-97b8-a62a1b6ae051 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:46.816899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1783c4ec-e289-4eb7-97b8-a62a1b6ae051 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:46.823128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1783c4ec-e289-4eb7-97b8-a62a1b6ae051 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:46.823585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1783c4ec-e289-4eb7-97b8-a62a1b6ae051 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:46.824386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1783c4ec-e289-4eb7-97b8-a62a1b6ae051 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:46.824825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1783c4ec-e289-4eb7-97b8-a62a1b6ae051 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:46.857286 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1783c4ec-e289-4eb7-97b8-a62a1b6ae051 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045376 Mar 08 20:10:46.857836 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 882/1729] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:47.112658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:47.113664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:47.119577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:47.120032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:47.120836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:47.121272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:47.187670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:47.195548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9fe51f08-1ef0-4a43-a7b8-379cad700bb3 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.086833 Mar 08 20:10:47.196635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 848/1730] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:47 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:47.869771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-eaf32852-a818-4add-b23e-d96f2c40324c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:47.870801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-eaf32852-a818-4add-b23e-d96f2c40324c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:47.877059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eaf32852-a818-4add-b23e-d96f2c40324c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:47.877504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eaf32852-a818-4add-b23e-d96f2c40324c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:47.878278 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eaf32852-a818-4add-b23e-d96f2c40324c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:47.878710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-eaf32852-a818-4add-b23e-d96f2c40324c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:47.907164 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-eaf32852-a818-4add-b23e-d96f2c40324c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 Mar 08 20:10:47.907702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 883/1731] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:48.213507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:48.214050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:48.220316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:48.220774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:48.221539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:48.221979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:48.279755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:48.287375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ff08fffc-bc7b-4574-be47-10a2cc83db88 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078403 Mar 08 20:10:48.287928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 849/1732] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:48 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:48.918743 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cae25d26-d008-4b26-9e13-0c0d66351413 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:48.919649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cae25d26-d008-4b26-9e13-0c0d66351413 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:48.925908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cae25d26-d008-4b26-9e13-0c0d66351413 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:48.926366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cae25d26-d008-4b26-9e13-0c0d66351413 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:48.927158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cae25d26-d008-4b26-9e13-0c0d66351413 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:48.927590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cae25d26-d008-4b26-9e13-0c0d66351413 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:48.955340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cae25d26-d008-4b26-9e13-0c0d66351413 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040663 Mar 08 20:10:48.955872 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 884/1733] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:49.303668 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:49.304272 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:49.311002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:49.311451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:49.312212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:49.312672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:49.370308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:49.377831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dde5d98a-d97e-4916-84c6-d3eb9b256c4b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078006 Mar 08 20:10:49.378386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 850/1734] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:49 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:49.967681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-232802c4-c1e7-4ab8-9933-2f6e1b7265bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:49.968628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-232802c4-c1e7-4ab8-9933-2f6e1b7265bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:49.974877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-232802c4-c1e7-4ab8-9933-2f6e1b7265bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:49.975330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-232802c4-c1e7-4ab8-9933-2f6e1b7265bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:49.976096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-232802c4-c1e7-4ab8-9933-2f6e1b7265bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:49.976559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-232802c4-c1e7-4ab8-9933-2f6e1b7265bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:50.004007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-232802c4-c1e7-4ab8-9933-2f6e1b7265bd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040351 Mar 08 20:10:50.004578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 885/1735] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:50.395105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:50.395745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:50.402259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:50.402708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:50.403470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:50.403904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:50.463075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:50.470698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-61b8494a-5059-477e-a485-ecd25dac76e8 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079403 Mar 08 20:10:50.471263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 851/1736] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:50 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:50.778328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:10:50.778518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:10:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:10:51.015199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4a80dfce-1732-4e16-b150-fb426d9cf262 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:51.016122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4a80dfce-1732-4e16-b150-fb426d9cf262 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:51.022230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a80dfce-1732-4e16-b150-fb426d9cf262 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:51.022684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a80dfce-1732-4e16-b150-fb426d9cf262 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:51.023453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a80dfce-1732-4e16-b150-fb426d9cf262 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:51.023894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4a80dfce-1732-4e16-b150-fb426d9cf262 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:51.051933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4a80dfce-1732-4e16-b150-fb426d9cf262 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040821 Mar 08 20:10:51.052447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 886/1737] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:51.487567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:51.488166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:51.494928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:51.495369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:51.496119 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:51.496577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:51.555333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:51.562930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f2b31fc3-962e-4952-ac9e-99a890f0cf9d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079195 Mar 08 20:10:51.563482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 852/1738] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:51 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:52.063071 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e1e87327-9089-41a2-aa94-0c532f7cd821 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:52.064026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e1e87327-9089-41a2-aa94-0c532f7cd821 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:52.070237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1e87327-9089-41a2-aa94-0c532f7cd821 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:52.070722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1e87327-9089-41a2-aa94-0c532f7cd821 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:52.071478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1e87327-9089-41a2-aa94-0c532f7cd821 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:52.071904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e1e87327-9089-41a2-aa94-0c532f7cd821 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:52.099908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e1e87327-9089-41a2-aa94-0c532f7cd821 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040826 Mar 08 20:10:52.100460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 887/1739] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:52.580347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:52.580964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:52.587985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:52.588460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:52.589222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:52.589680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:52.654454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:52.662259 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-39de30bf-ca6b-44b1-ba06-1af72df39abb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.085784 Mar 08 20:10:52.662814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 853/1740] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:52 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:53.111693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e746eb54-cc9f-419e-b012-175a9b84c216 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:53.113157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e746eb54-cc9f-419e-b012-175a9b84c216 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:53.119365 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e746eb54-cc9f-419e-b012-175a9b84c216 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:53.119805 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e746eb54-cc9f-419e-b012-175a9b84c216 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:53.120592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e746eb54-cc9f-419e-b012-175a9b84c216 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:53.121022 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e746eb54-cc9f-419e-b012-175a9b84c216 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:53.148776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e746eb54-cc9f-419e-b012-175a9b84c216 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041004 Mar 08 20:10:53.149314 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 888/1741] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:53.678868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:53.679485 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:53.685830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:53.686274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:53.687037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:53.687471 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:53.751218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:53.759844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6888de01-2ff2-4a0c-8517-4b514d79631f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.084776 Mar 08 20:10:53.760428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 854/1742] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:53 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:54.160258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a65678f1-e17a-499b-98dc-f2af82c83507 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:54.161199 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a65678f1-e17a-499b-98dc-f2af82c83507 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:54.167673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a65678f1-e17a-499b-98dc-f2af82c83507 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:54.168124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a65678f1-e17a-499b-98dc-f2af82c83507 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:54.168934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a65678f1-e17a-499b-98dc-f2af82c83507 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:54.169372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a65678f1-e17a-499b-98dc-f2af82c83507 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:54.197704 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a65678f1-e17a-499b-98dc-f2af82c83507 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Mar 08 20:10:54.198255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 889/1743] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:54.777757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:54.778368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:54.784600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:54.785048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:54.785810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:54.786250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:54.845155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:54.852864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fd20c8ed-8ea3-4161-ab68-1ee157b4748b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079954 Mar 08 20:10:54.853360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 855/1744] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:54 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:55.208922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-44139d1f-045b-4365-a46f-72d7aa586a1d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:55.209829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-44139d1f-045b-4365-a46f-72d7aa586a1d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:55.216544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44139d1f-045b-4365-a46f-72d7aa586a1d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:55.216991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44139d1f-045b-4365-a46f-72d7aa586a1d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:55.217744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44139d1f-045b-4365-a46f-72d7aa586a1d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:55.218176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-44139d1f-045b-4365-a46f-72d7aa586a1d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:55.245721 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-44139d1f-045b-4365-a46f-72d7aa586a1d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040778 Mar 08 20:10:55.246251 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 890/1745] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:55.870033 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:55.870644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:55.876913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:55.877360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:55.878121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:55.878555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:55.937532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:55.945009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2e3bfc60-c805-418c-ab3d-67a713dd041f tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079407 Mar 08 20:10:55.945563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 856/1746] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:55 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:10:56.257068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e356b36c-8333-4d23-b2f3-c7099fcfc97e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:56.258490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e356b36c-8333-4d23-b2f3-c7099fcfc97e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:56.264683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e356b36c-8333-4d23-b2f3-c7099fcfc97e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:56.265138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e356b36c-8333-4d23-b2f3-c7099fcfc97e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:56.265896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e356b36c-8333-4d23-b2f3-c7099fcfc97e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:56.266329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e356b36c-8333-4d23-b2f3-c7099fcfc97e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:56.294546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e356b36c-8333-4d23-b2f3-c7099fcfc97e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Mar 08 20:10:56.295084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 891/1747] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:56.962421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:56.963036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:56.969368 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:56.969822 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:56.970600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:56.971041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:57.031416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:57.039053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-52d5523b-6589-413b-a207-30ae4ff4b6cb tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081140 Mar 08 20:10:57.039621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 857/1748] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:56 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:57.306678 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7159b6b2-5659-4bad-9094-03d709ed8ef8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:57.307579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7159b6b2-5659-4bad-9094-03d709ed8ef8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:57.313820 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7159b6b2-5659-4bad-9094-03d709ed8ef8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:57.314262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7159b6b2-5659-4bad-9094-03d709ed8ef8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:57.315018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7159b6b2-5659-4bad-9094-03d709ed8ef8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:57.315448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7159b6b2-5659-4bad-9094-03d709ed8ef8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:57.343015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7159b6b2-5659-4bad-9094-03d709ed8ef8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040885 Mar 08 20:10:57.343522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 892/1749] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:58.055278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:58.055979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:58.062302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:58.062754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:58.063519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:58.063954 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:58.122558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:58.130307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-79ea4ed4-e1f8-42a7-b28d-ba6af7129bab tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078865 Mar 08 20:10:58.130859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 858/1750] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:58 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:58.354393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a6f6c295-179e-4246-869e-4013e305605a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:58.355301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a6f6c295-179e-4246-869e-4013e305605a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:58.361516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6f6c295-179e-4246-869e-4013e305605a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:58.362033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6f6c295-179e-4246-869e-4013e305605a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:58.362733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6f6c295-179e-4246-869e-4013e305605a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:58.363166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6f6c295-179e-4246-869e-4013e305605a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:58.391167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a6f6c295-179e-4246-869e-4013e305605a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040742 Mar 08 20:10:58.391695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 893/1751] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:10:59.147139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:59.147760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:59.154623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:59.155079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:59.155845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:59.156308 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:59.215762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:10:59.223408 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b56d478b-8283-42cd-a81b-6fdcc719fe0a tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080404 Mar 08 20:10:59.223992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 859/1752] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:10:59 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:10:59.403375 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8073bd27-14ac-48a8-9cc7-e9f86b644545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:10:59.404337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8073bd27-14ac-48a8-9cc7-e9f86b644545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:10:59.410456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8073bd27-14ac-48a8-9cc7-e9f86b644545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:59.410896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8073bd27-14ac-48a8-9cc7-e9f86b644545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:59.411653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8073bd27-14ac-48a8-9cc7-e9f86b644545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:10:59.412082 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8073bd27-14ac-48a8-9cc7-e9f86b644545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:10:59.438866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8073bd27-14ac-48a8-9cc7-e9f86b644545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039911 Mar 08 20:10:59.439400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 894/1753] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:10:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:00.239874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:00.240515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:00.246851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:00.247307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:00.248080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:00.248552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:00.311789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:00.319743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0152caf2-f478-4f72-9db2-e1c45c479a64 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083730 Mar 08 20:11:00.320347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 860/1754] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:00 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:00.450323 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d879c95a-8d97-4ed5-b310-2ebb84c774a6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:00.451160 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d879c95a-8d97-4ed5-b310-2ebb84c774a6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:00.457718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d879c95a-8d97-4ed5-b310-2ebb84c774a6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:00.458169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d879c95a-8d97-4ed5-b310-2ebb84c774a6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:00.458935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d879c95a-8d97-4ed5-b310-2ebb84c774a6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:00.459370 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d879c95a-8d97-4ed5-b310-2ebb84c774a6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:00.487430 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d879c95a-8d97-4ed5-b310-2ebb84c774a6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 Mar 08 20:11:00.487965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 895/1755] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:01.336932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:01.337529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:01.343793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:01.344238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:01.345030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:01.345463 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:01.404817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:01.412506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c9ffc80f-4856-419b-8e12-c9e014b9a271 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079956 Mar 08 20:11:01.413062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 861/1756] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:01 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:01.499433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9298a607-fc81-4916-a78a-12f61b7f3a80 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:01.500371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9298a607-fc81-4916-a78a-12f61b7f3a80 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:01.506579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9298a607-fc81-4916-a78a-12f61b7f3a80 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:01.507032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9298a607-fc81-4916-a78a-12f61b7f3a80 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:01.507836 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9298a607-fc81-4916-a78a-12f61b7f3a80 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:01.508396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9298a607-fc81-4916-a78a-12f61b7f3a80 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:01.537484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9298a607-fc81-4916-a78a-12f61b7f3a80 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042008 Mar 08 20:11:01.538035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 896/1757] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:02.429123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:02.429696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:02.437755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:02.438205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:02.438979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:02.439411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:02.499042 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:02.506817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bde8713d-c0f1-418f-b89a-129ef155c3ec tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.081638 Mar 08 20:11:02.507370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 862/1758] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:02 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:02.549205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-31401789-73df-4cf8-a11a-8ac4a7603e21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:02.550141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-31401789-73df-4cf8-a11a-8ac4a7603e21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:02.556443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31401789-73df-4cf8-a11a-8ac4a7603e21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:02.556897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31401789-73df-4cf8-a11a-8ac4a7603e21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:02.557663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31401789-73df-4cf8-a11a-8ac4a7603e21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:02.558098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-31401789-73df-4cf8-a11a-8ac4a7603e21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:02.585703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-31401789-73df-4cf8-a11a-8ac4a7603e21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040500 Mar 08 20:11:02.586853 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 897/1759] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:03.524627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:03.525179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:03.531830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:03.532314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:03.533068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:03.533501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:03.591932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:03.597564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3fdfbdec-31ff-4712-b6f8-575d907fed42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:03.598487 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3fdfbdec-31ff-4712-b6f8-575d907fed42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:03.599915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6743a48d-aaa6-4a0d-9c99-14069b4d564b tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079579 Mar 08 20:11:03.600504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 863/1760] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:03 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:03.605326 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fdfbdec-31ff-4712-b6f8-575d907fed42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:03.605793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fdfbdec-31ff-4712-b6f8-575d907fed42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:03.606573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fdfbdec-31ff-4712-b6f8-575d907fed42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:03.607016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fdfbdec-31ff-4712-b6f8-575d907fed42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:03.634616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3fdfbdec-31ff-4712-b6f8-575d907fed42 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040916 Mar 08 20:11:03.635162 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 898/1761] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:11:04.545057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:11:04.545292 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:11:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:11:04.616637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:04.617299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:04.623516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:04.623962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:04.624756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:04.625188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:04.646040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9da5cebf-5672-4019-83e9-718ce48bfec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:04.647217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9da5cebf-5672-4019-83e9-718ce48bfec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:04.654075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9da5cebf-5672-4019-83e9-718ce48bfec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:04.654530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9da5cebf-5672-4019-83e9-718ce48bfec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:04.655342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9da5cebf-5672-4019-83e9-718ce48bfec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:04.655781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9da5cebf-5672-4019-83e9-718ce48bfec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:04.685710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9da5cebf-5672-4019-83e9-718ce48bfec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043165 Mar 08 20:11:04.685918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 899/1762] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:11:04.687647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:04.696152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fb01830b-47fc-42ba-b2f4-94befbe3850d tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.083329 Mar 08 20:11:04.696776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 864/1763] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:04 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:05.696457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a35d3f9e-8371-4b0b-abac-5e88a6021299 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:05.697363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a35d3f9e-8371-4b0b-abac-5e88a6021299 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:05.703471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a35d3f9e-8371-4b0b-abac-5e88a6021299 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:05.703949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a35d3f9e-8371-4b0b-abac-5e88a6021299 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:05.704749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a35d3f9e-8371-4b0b-abac-5e88a6021299 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:05.705179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a35d3f9e-8371-4b0b-abac-5e88a6021299 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:05.712729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:05.713340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:05.719617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:05.720069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:05.720875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:05.721313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:05.732516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a35d3f9e-8371-4b0b-abac-5e88a6021299 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040548 Mar 08 20:11:05.733061 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 900/1764] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:05.780491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:05.788123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b6d0d0d7-1bb3-4e58-a6d3-4b84f05f30a0 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079224 Mar 08 20:11:05.788715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 865/1765] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:05 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:11:06.743712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c2a687e7-c2e4-44ce-a796-1d6dd05adb16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:06.744651 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c2a687e7-c2e4-44ce-a796-1d6dd05adb16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:06.750908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c2a687e7-c2e4-44ce-a796-1d6dd05adb16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:06.751362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c2a687e7-c2e4-44ce-a796-1d6dd05adb16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:06.752144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c2a687e7-c2e4-44ce-a796-1d6dd05adb16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:06.752601 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c2a687e7-c2e4-44ce-a796-1d6dd05adb16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:06.781163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c2a687e7-c2e4-44ce-a796-1d6dd05adb16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Mar 08 20:11:06.781692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 901/1766] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:06.805279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:06.805881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:06.811650 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:06.812095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:06.812881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:06.813310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:06.874073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:06.881701 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1a17db2c-e821-4e42-9170-f979011911c9 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.080356 Mar 08 20:11:06.882253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 866/1767] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:06 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:07.792989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6fd6583d-5e7f-4466-a729-453471822aaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:07.793926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6fd6583d-5e7f-4466-a729-453471822aaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:07.800168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6fd6583d-5e7f-4466-a729-453471822aaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:07.800655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6fd6583d-5e7f-4466-a729-453471822aaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:07.801426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6fd6583d-5e7f-4466-a729-453471822aaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:07.801868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6fd6583d-5e7f-4466-a729-453471822aaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:07.829499 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6fd6583d-5e7f-4466-a729-453471822aaf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040953 Mar 08 20:11:07.830038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 902/1768] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:07.899527 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:07.900137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:07.906364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:07.906814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:07.907575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:07.908010 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:07.965836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:07.973427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0b58f470-c56e-40a2-8a25-f12a09d627e1 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078482 Mar 08 20:11:07.973985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 867/1769] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:07 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:08.841414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-224d411e-fc44-412a-90ed-b2d1cec88ba3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:08.842385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-224d411e-fc44-412a-90ed-b2d1cec88ba3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:08.848755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-224d411e-fc44-412a-90ed-b2d1cec88ba3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:08.849208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-224d411e-fc44-412a-90ed-b2d1cec88ba3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:08.849974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-224d411e-fc44-412a-90ed-b2d1cec88ba3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:08.850419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-224d411e-fc44-412a-90ed-b2d1cec88ba3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:08.878156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-224d411e-fc44-412a-90ed-b2d1cec88ba3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040720 Mar 08 20:11:08.878693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 903/1770] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:08.990504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:08.991118 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:08.997424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:08.997880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:08.998651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:08.999088 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:09.057081 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:09.064729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0ce8b7e0-db20-4bf3-9d41-75d887864ad4 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.077997 Mar 08 20:11:09.065231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 868/1771] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:08 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:09.889711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4fa68da0-4f36-4743-9e31-6a47ee9deaef tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:09.890625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4fa68da0-4f36-4743-9e31-6a47ee9deaef tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:09.897094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4fa68da0-4f36-4743-9e31-6a47ee9deaef tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:09.897547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4fa68da0-4f36-4743-9e31-6a47ee9deaef tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:09.898893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4fa68da0-4f36-4743-9e31-6a47ee9deaef tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:09.899335 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4fa68da0-4f36-4743-9e31-6a47ee9deaef tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:09.926381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4fa68da0-4f36-4743-9e31-6a47ee9deaef tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040694 Mar 08 20:11:09.926916 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 904/1772] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:10.083365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:10.084005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:10.090829 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:10.091277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:10.092041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:10.092507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:10.150797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:10.158498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5d894db3-de95-470c-9e19-4f86a5a31e21 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.078994 Mar 08 20:11:10.159061 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 869/1773] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:10 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:10.937866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5b9a19c7-7401-4c5a-919b-72b31f3490c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:10.938780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5b9a19c7-7401-4c5a-919b-72b31f3490c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:10.945002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b9a19c7-7401-4c5a-919b-72b31f3490c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:10.945445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b9a19c7-7401-4c5a-919b-72b31f3490c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:10.946200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b9a19c7-7401-4c5a-919b-72b31f3490c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:10.946632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b9a19c7-7401-4c5a-919b-72b31f3490c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:10.974630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5b9a19c7-7401-4c5a-919b-72b31f3490c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040769 Mar 08 20:11:10.975169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 905/1774] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:11.175340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:11.176046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:11.182840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:11.183298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:11.184069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:11.184605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:11.243261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:11.250910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-feefdf00-aabf-4647-9444-ab1eec7e91e7 tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.079422 Mar 08 20:11:11.251468 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 870/1775] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:11 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:11.986118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5698e11c-81d5-49c2-a507-19cb6cb3c400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:11.987030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5698e11c-81d5-49c2-a507-19cb6cb3c400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:11.993840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5698e11c-81d5-49c2-a507-19cb6cb3c400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:11.994289 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5698e11c-81d5-49c2-a507-19cb6cb3c400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:11.995049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5698e11c-81d5-49c2-a507-19cb6cb3c400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:11.995482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5698e11c-81d5-49c2-a507-19cb6cb3c400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:12.030398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5698e11c-81d5-49c2-a507-19cb6cb3c400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048189 Mar 08 20:11:12.030932 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 906/1776] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:11:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:11:12.268226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:11:12.268787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] [instance: cf15cfb8-7c73-418b-b268-1fc064fc717f] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:12.275276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:12.275724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:12.276516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:12.276951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:12.341837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f754cb584f49488a8f18919b1a40512b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465b155dca1452a855efa3b5794a21e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:11:12.349845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ed507825-67c6-4cab-a751-7d4f31e041ba tempest-VolumesSnapshotTestJSON-370402356 tempest-VolumesSnapshotTestJSON-370402356-project] 10.222.0.45 "GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f" status: 200 len: 1349 microversion: 2.1 time: 0.085551 Mar 08 20:11:12.350403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 871/1777] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:11:12 2022] GET /compute/v2.1/servers/cf15cfb8-7c73-418b-b268-1fc064fc717f => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:11:13.042385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c3b82024-bbd2-4f11-b884-bbb98e5f3d22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:11:13.043245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c3b82024-bbd2-4f11-b884-bbb98e5f3d22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:11:13.049441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3b82024-bbd2-4f11-b884-bbb98e5f3d22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:13.049886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3b82024-bbd2-4f11-b884-bbb98e5f3d22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:13.050640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3b82024-bbd2-4f11-b884-bbb98e5f3d22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:11:13.051072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3b82024-bbd2-4f11-b884-bbb98e5f3d22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:11:13.125697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c3b82024-bbd2-4f11-b884-bbb98e5f3d22 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "POST /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/action" status: 200 len: 41609 microversion: 2.1 time: 0.087544 Mar 08 20:11:13.126605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 907/1778] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 20:11:13 2022] POST /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77/action => generated 41609 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 20:12:13.078613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:12:13.079154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:12:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:12:38.976975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:12:38.977451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:14:03.472186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:14:03.472909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:14:10.786310 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:14:10.786911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:14:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:14:13.210895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:14:13.211518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:14:24.553201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:14:24.553739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:14:55.020134 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5fc28641-8eb5-40a2-8b2d-f95217507270] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 08 20:14:55.023984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:14:55.024521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:14:55.030344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.030798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.032103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.032567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.201510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 could not be found. Mar 08 20:14:55.202107 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:14:55.202937 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c461cb15-ac43-4baf-9d83-472d84aa8c28 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 404 len: 111 microversion: 2.1 time: 0.184898 Mar 08 20:14:55.203998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 872/1779] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:14:55 2022] DELETE /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:14:55.210330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b76eb3e6-7338-481b-b368-ce9bb987c6b9] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 08 20:14:55.214418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:14:55.215101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b37d3efc-2ed3-4421-8b7b-482ebff040b3] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:14:55.222033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.222483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.223249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.223683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.236713 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 could not be found. Mar 08 20:14:55.237297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance b37d3efc-2ed3-4421-8b7b-482ebff040b3 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:14:55.238157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7d60a8d2-6681-4993-91f2-2c26721d6ada tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3" status: 404 len: 111 microversion: 2.1 time: 0.029722 Mar 08 20:14:55.238664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 908/1780] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:14:55 2022] GET /compute/v2.1/servers/b37d3efc-2ed3-4421-8b7b-482ebff040b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:14:55.246294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:14:55.246791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:14:55.252477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.252932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.253685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.254115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.267077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance b7092a06-ffd5-4d33-883b-eee953ed48fd could not be found. Mar 08 20:14:55.267651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance b7092a06-ffd5-4d33-883b-eee953ed48fd could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:14:55.268733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-44078f6e-95a3-4914-9ac1-271e6f422072 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 404 len: 111 microversion: 2.1 time: 0.025947 Mar 08 20:14:55.269233 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 873/1781] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:14:55 2022] DELETE /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:14:55.276661 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:14:55.277266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: b7092a06-ffd5-4d33-883b-eee953ed48fd] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:14:55.283414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.283860 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.284646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:14:55.285083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:14:55.297852 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance b7092a06-ffd5-4d33-883b-eee953ed48fd could not be found. Mar 08 20:14:55.298427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance b7092a06-ffd5-4d33-883b-eee953ed48fd could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:14:55.299247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5e4039fb-8bec-49f5-8ac5-9efa1dfb4eda tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd" status: 404 len: 111 microversion: 2.1 time: 0.026295 Mar 08 20:14:55.299747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 909/1782] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:14:55 2022] GET /compute/v2.1/servers/b7092a06-ffd5-4d33-883b-eee953ed48fd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:15:33.087541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:15:33.088054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:15:58.985426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:15:58.985893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:15:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:17:23.480361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:17:23.481042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:17:30.794168 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:17:30.794768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:17:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:17:33.218919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:17:33.219724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:17:44.561362 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:17:44.561948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:18:53.095756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:18:53.096235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:18:55.872625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:18:55.874152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:18:55.888467 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] [5fc28641-8eb5-40a2-8b2d-f95217507270] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 53364. Mar 08 20:18:55.893398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:55.894290 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:55.895481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:55.896132 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:55.925787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:18:56.009585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3bf42923-9c05-4571-8a7f-88d8f68d9c21 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 204 len: 0 microversion: 2.1 time: 0.143126 Mar 08 20:18:56.010167 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 874/1783] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:18:55 2022] DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:18:56.023313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:18:56.024125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:18:56.035012 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] [b76eb3e6-7338-481b-b368-ce9bb987c6b9] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 53376. Mar 08 20:18:56.039725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:56.040245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:56.041115 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:56.041640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:56.316197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:18:56.323908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-30025e6e-47c8-49ae-8a40-6e3dab68eff4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1720 microversion: 2.1 time: 0.308307 Mar 08 20:18:56.324527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 910/1784] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:18:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:18:57.342880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:18:57.343733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:18:57.349755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:57.350200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:57.350988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:57.351422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:57.487251 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:18:57.499871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-02944116-5424-4f00-8191-a8eb1dbcc7b3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1652 microversion: 2.1 time: 0.161429 Mar 08 20:18:57.500452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 875/1785] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:18:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1652 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:18:57.536465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-f24508b4-4526-438f-a75f-eaf09bddc8b1 req-5a5a53f5-01bb-4c6f-aec7-41acdd6635a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb579508-9118-47e4-a758-8e9c83890f77", "name": "network-vif-deleted", "tag": "a295e990-86a1-493f-840d-bbb1864b6780"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:18:57.546702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-f24508b4-4526-438f-a75f-eaf09bddc8b1 req-5a5a53f5-01bb-4c6f-aec7-41acdd6635a6 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:57.547169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-f24508b4-4526-438f-a75f-eaf09bddc8b1 req-5a5a53f5-01bb-4c6f-aec7-41acdd6635a6 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:57.558573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-f24508b4-4526-438f-a75f-eaf09bddc8b1 req-5a5a53f5-01bb-4c6f-aec7-41acdd6635a6 service nova] Creating event network-vif-deleted:a295e990-86a1-493f-840d-bbb1864b6780 for instance fb579508-9118-47e4-a758-8e9c83890f77 on hv-cinder-83009 Mar 08 20:18:57.564739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-f24508b4-4526-438f-a75f-eaf09bddc8b1 req-5a5a53f5-01bb-4c6f-aec7-41acdd6635a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108439 Mar 08 20:18:57.565330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 911/1786] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:18:58.517674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:18:58.518240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:18:58.524412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:58.524858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:58.525619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:58.526049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:58.586181 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:18:58.594125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2499474-23e2-4c92-bdca-2ffec90c71b2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080747 Mar 08 20:18:58.594680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 876/1787] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:18:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:18:59.611809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:18:59.612566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:18:59.618622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:59.619076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:59.619848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:18:59.620954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:18:59.679915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:18:59.688203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-97e99ca8-33e3-45df-8f1e-a7243330994d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081155 Mar 08 20:18:59.688809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 912/1788] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:18:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:00.705403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:00.705989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:00.712241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:00.712727 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:00.713546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:00.713987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:00.773899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:00.781555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3e997474-60f7-453b-a74e-868d531d9452 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080057 Mar 08 20:19:00.782108 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 877/1789] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:19:01.798566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:01.799173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:01.805459 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:01.805908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:01.806673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:01.807105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:01.865871 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:01.873685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1173f03e-bd86-42da-ad32-1f3fbba17aeb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078964 Mar 08 20:19:01.874236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 913/1790] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:02.890906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:02.891515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:02.897800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:02.898254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:02.899021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:02.899457 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:02.959754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:02.967763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2c34e228-954a-4b8f-bf8d-2accd2ad9547 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080963 Mar 08 20:19:02.968400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 878/1791] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:03.985044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:03.985655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:03.991921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:03.992406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:03.993178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:03.993613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:04.054498 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:04.062312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-29a2ee3a-ab5b-44ea-bcf8-49be6e0b51f7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081123 Mar 08 20:19:04.062868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 914/1792] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:05.077997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:05.078599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:05.084871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:05.085423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:05.086186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:05.086619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:05.145201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:05.152835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5093c63c-7651-42c8-9244-09a6a558c0a0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078652 Mar 08 20:19:05.153396 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 879/1793] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:06.169618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:06.170205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:06.176462 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:06.176912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:06.177670 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:06.178102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:06.236217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:06.243914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ba37ca3b-47d4-47c6-ad92-2da4ae956f9e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078104 Mar 08 20:19:06.244539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 915/1794] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:07.261707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:07.262292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:07.268738 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:07.269186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:07.269941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:07.270369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:07.328967 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:07.336735 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-835727d4-08df-4906-9ba1-e678deda1f75 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079117 Mar 08 20:19:07.337401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 880/1795] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:08.353411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:08.354019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:08.360543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:08.360994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:08.361759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:08.362193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:08.422808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:08.430345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5af3ae27-8175-4087-985c-26536ce3055e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080676 Mar 08 20:19:08.430902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 916/1796] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:09.446657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:09.447284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:09.453521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:09.453966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:09.454720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:09.455157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:09.513959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:09.521881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b7755178-116f-4b65-8d91-db73099e6538 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079015 Mar 08 20:19:09.522426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 881/1797] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:10.538085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:10.538724 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:10.546722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:10.547172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:10.547949 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:10.548418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:10.606414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:10.614104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1bc56585-7a6c-4407-9cd8-7bdcd376e03f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079764 Mar 08 20:19:10.614656 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 917/1798] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:11.630711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:11.631339 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:11.637689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:11.638146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:11.638920 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:11.639623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:11.700900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:11.708640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3a0f3b98-b4e5-4d81-8b88-85571661fe07 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081790 Mar 08 20:19:11.709193 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 882/1799] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:12.725092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:12.725700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:12.732425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:12.732878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:12.733643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:12.734075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:12.793501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:12.801048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8b4049df-7ad4-470b-b74f-487c2ffaf84c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079790 Mar 08 20:19:12.801607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 918/1800] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:13.817553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:13.818166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:13.826929 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:13.827410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:13.828148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:13.828624 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:13.887632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:13.895594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1f44657e-74ec-4315-986f-49ea05696e5c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081880 Mar 08 20:19:13.896147 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 883/1801] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:14.912588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:14.913113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:14.919292 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:14.919745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:14.920546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:14.920980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:14.983037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:14.990677 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9e95a60d-e8b6-4def-b1c8-58e12e979f0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082091 Mar 08 20:19:14.991237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 919/1802] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:16.007771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:16.008375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:16.014746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:16.015189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:16.015946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:16.016397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:16.075677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:16.083356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-def22c78-59cd-493f-b455-9c0bf5a2111c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079485 Mar 08 20:19:16.083900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 884/1803] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:17.100561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:17.101178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:17.107895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:17.108382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:17.109157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:17.109598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:17.171580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:17.179336 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ffa70f12-b7b4-4e63-9205-d088dfedd3ff tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082652 Mar 08 20:19:17.179895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 920/1804] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:18.195949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:18.196592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:18.202866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:18.203313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:18.204080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:18.204547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:18.262326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:18.273598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d2858449-bfab-45ee-81aa-877c9e2ab00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081448 Mar 08 20:19:18.274163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 885/1805] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:18.993052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:19:18.993529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:19:19.292965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:19.293563 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:19.299771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:19.300215 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:19.300995 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:19.301422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:19.359608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:19.367164 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4f8fc98a-c3f8-4836-a445-9010807cd103 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078041 Mar 08 20:19:19.367711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 921/1806] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:20.383580 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:20.384186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:20.390776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:20.391222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:20.391987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:20.392460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:20.452881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:20.460565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bcfae1dd-f561-405d-bb96-ab463e41652e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080845 Mar 08 20:19:20.461121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 886/1807] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:21.477798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:21.478410 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:21.485165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:21.485617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:21.486386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:21.486821 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:21.545642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:21.553361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-01463f33-dbb5-4056-a99c-b6f70729f96a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079456 Mar 08 20:19:21.553919 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 922/1808] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:22.570510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:22.571195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:22.577413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:22.577866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:22.578636 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:22.579072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:22.637265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:22.645273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2e75a026-30d2-4338-b3d6-4e309fa3e406 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078590 Mar 08 20:19:22.645814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 887/1809] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:23.662035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:23.662662 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:23.668950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:23.669403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:23.670173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:23.670608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:23.731710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:23.739544 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7461ecec-68b0-4653-b938-8cc1e95ad054 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081336 Mar 08 20:19:23.740103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 923/1810] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:24.756232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:24.756872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:24.763641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:24.764529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:24.765321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:24.765763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:24.826670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:24.834544 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-461fd555-cf04-4a2c-81b1-c1691c572ec2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082215 Mar 08 20:19:24.835089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 888/1811] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:25.850725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:25.851337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:25.857492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:25.857947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:25.858722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:25.859138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:25.921962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:25.929647 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0851a416-2d0b-4deb-a092-3cecf3eac96b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082806 Mar 08 20:19:25.930201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 924/1812] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:26.946332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:26.946946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:26.952838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:26.953289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:26.954062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:26.954498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:27.012430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:27.020356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f00d17ae-0575-4b68-8be3-781f212499be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077971 Mar 08 20:19:27.020911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 889/1813] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:28.037628 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:28.038458 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:28.046650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:28.047106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:28.047878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:28.048334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:28.109486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:28.117905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-29f273cc-b426-4a07-87f5-da7b421bed55 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084279 Mar 08 20:19:28.118472 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 925/1814] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:29.134518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:29.135190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:29.141949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:29.142397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:29.143162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:29.143597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:29.204226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:29.211957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-55be9348-5200-409b-83d3-722c2d4f9f3e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081271 Mar 08 20:19:29.212542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 890/1815] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:30.228685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:30.229294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:30.235577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:30.236024 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:30.236811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:30.237247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:30.299329 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:30.307538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-78e2bd74-4a32-4634-9a0f-b9ed945523bf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082652 Mar 08 20:19:30.308094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 926/1816] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:31.324631 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:31.325247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:31.331562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:31.331959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:31.332776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:31.333199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:31.392894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:31.401200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-24d99f1e-8621-490a-a964-1e21a2a95e83 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080405 Mar 08 20:19:31.401764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 891/1817] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:32.418484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:32.419052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:32.425298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:32.425748 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:32.426511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:32.426946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:32.486639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:32.496497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8f8f08b9-c934-48a7-a67f-7b22d3551ca0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082396 Mar 08 20:19:32.497075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 927/1818] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:33.513581 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:33.514526 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:33.521184 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:33.521583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:33.522352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:33.522787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:33.581758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:33.589393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c47cb997-b9b1-4cac-afb1-178f0ff161ab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079932 Mar 08 20:19:33.589960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 892/1819] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:34.606283 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:34.606884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:34.613069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:34.613515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:34.614313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:34.614692 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:34.672454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:34.680262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9d1d888e-321b-45e8-8f72-f041f68aee9c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078324 Mar 08 20:19:34.680856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 928/1820] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:35.697520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:35.698072 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:35.704509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:35.704966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:35.705730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:35.706163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:35.765240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:35.772828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a9696931-1223-41ea-8a44-127f6b73444e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080059 Mar 08 20:19:35.773382 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 893/1821] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:36.789693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:36.790258 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:36.797100 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:36.797554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:36.798321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:36.798760 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:36.856314 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:36.863895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-235de5e9-6246-4f47-9954-efa32c173981 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078079 Mar 08 20:19:36.864476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 929/1822] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:37.880614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:37.881226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:37.888054 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:37.888542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:37.889572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:37.890014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:37.950524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:37.958441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-89d87a94-7070-47ea-a5d3-dda90810ff79 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081740 Mar 08 20:19:37.958998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 894/1823] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:38.979027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:38.979956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:38.986586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:38.987035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:38.987829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:38.988264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:39.047231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:39.054787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-08c1aed4-a3f3-4285-9b8d-25e78bea5205 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080386 Mar 08 20:19:39.055343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 930/1824] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:40.070859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:40.071474 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:40.078354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:40.078807 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:40.079586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:40.080028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:40.138425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:40.146422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4861be8c-4614-4e72-af53-585453350c1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079469 Mar 08 20:19:40.146970 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 895/1825] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:41.162908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:41.163521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:41.169775 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:41.170229 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:41.170999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:41.171445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:41.230332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:41.237999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-817217f0-bd89-494a-8125-fb34e6e6b27e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078984 Mar 08 20:19:41.238562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 931/1826] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:42.254894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:42.255500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:42.262333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:42.262783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:42.263547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:42.264261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:42.321416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:42.329789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2eb510e6-be25-4c4e-8222-f64b9f7b6c14 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078754 Mar 08 20:19:42.330345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 896/1827] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:43.346466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:43.346985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:43.353583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:43.354028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:43.354776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:43.355205 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:43.417830 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:43.425565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-976f0302-20b1-4024-a311-c1983a8ecfbd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082991 Mar 08 20:19:43.426122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 932/1828] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:44.442980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:44.443582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:44.450278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:44.450722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:44.451493 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:44.451920 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:44.511189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:44.518986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-16d08260-d952-4b68-8953-4b6d6f237e92 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079957 Mar 08 20:19:44.519546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 897/1829] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:45.535526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:45.536134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:45.542902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:45.543355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:45.544123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:45.544591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:45.602190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:45.610332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f3e50d3d-2fd0-4fde-b74a-98f541793721 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078687 Mar 08 20:19:45.610890 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 933/1830] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:46.627376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:46.627987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:46.634309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:46.634761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:46.635525 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:46.635960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:46.697548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:46.705312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f196e8d0-96bf-472e-9aad-a0e668bdbde1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081807 Mar 08 20:19:46.705864 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 898/1831] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:47.722301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:47.722907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:47.729903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:47.730359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:47.731139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:47.731578 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:47.797593 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:47.805383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-85a6f00a-3a97-4443-b683-5705004231f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.087239 Mar 08 20:19:47.805951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 934/1832] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:48.829469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:48.830069 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:48.836267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:48.836754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:48.837542 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:48.837988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:48.896162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:48.903832 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5d172f10-4322-48e0-9af6-77849eaf8d4e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078252 Mar 08 20:19:48.904416 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 899/1833] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:49.920914 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:49.921528 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:49.927701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:49.928155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:49.928979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:49.929422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:49.987244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:49.995479 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-375783b1-e4f0-4a2a-b40e-967555015d49 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078454 Mar 08 20:19:49.996043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 935/1834] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:51.012164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:51.021949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:51.021949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:51.021949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:51.021949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:51.022385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:51.079945 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:51.088208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-534a2d43-0714-4115-bd8d-f72f2da97525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079919 Mar 08 20:19:51.088917 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 900/1835] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:52.105359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:52.106034 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:52.112755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:52.113600 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:52.113964 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:52.114399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:52.176612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:52.185285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8bfe985f-9b41-4462-9e9f-22a8aea12031 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083767 Mar 08 20:19:52.185851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 936/1836] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:53.202400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:53.202999 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:53.209236 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:53.209682 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:53.210439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:53.210870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:53.268890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:53.276521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0c6901af-5870-4cbd-8308-764718cd3b33 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077921 Mar 08 20:19:53.277080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 901/1837] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:54.293076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:54.293676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:54.300152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:54.300622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:54.301372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:54.301797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:54.359543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:54.367096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-47b24fed-e6a9-4e32-8c00-e1bf13ce6208 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077918 Mar 08 20:19:54.367597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 937/1838] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:55.384224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:55.384819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:55.391501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:55.392060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:55.392863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:55.393294 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:55.453553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:55.461099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-073bf844-f6a9-463a-aaab-63b13cfa84ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080835 Mar 08 20:19:55.461658 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 902/1839] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:56.478706 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:56.479264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:56.485543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:56.485998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:56.486763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:56.487200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:56.549165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:56.557297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-557f5903-59fd-46d9-b773-dad0ec55d5bb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082831 Mar 08 20:19:56.557856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 938/1840] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:57.574012 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:57.574635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:57.580518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:57.580975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:57.581739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:57.582177 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:57.640398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:57.648035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3006bc0e-6a1f-4e98-aeee-848713fd4618 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078138 Mar 08 20:19:57.648642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 903/1841] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:58.664562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:58.665797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:58.672408 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:58.672857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:58.673611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:58.674043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:58.731747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:58.739579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-19abec39-c884-4ff0-91fe-08a4dbc5d8c9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078884 Mar 08 20:19:58.740133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 939/1842] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:19:59.755685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:19:59.756275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:19:59.763008 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:59.763708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:59.764500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:19:59.764947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:19:59.825293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:19:59.832915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-621e188a-85cf-4ceb-90ad-8fc90ca949b7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081075 Mar 08 20:19:59.833469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 904/1843] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:19:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:00.850834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:00.851441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:00.857612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:00.858056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:00.858807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:00.859236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:00.916970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:00.924569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-721d294d-71f6-4d85-b663-dc7cea286b5f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077493 Mar 08 20:20:00.925122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 940/1844] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:01.942760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:01.943367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:01.950112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:01.950564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:01.951332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:01.951776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:02.009216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:02.017071 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-36d93f71-39e9-4204-a8a2-2f6cc2582118 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078256 Mar 08 20:20:02.017623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 905/1845] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:03.034355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:03.034962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:03.041234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:03.041690 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:03.042457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:03.042904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:03.101333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:03.109206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a287fe50-5c48-4f87-9698-7a878fa3e384 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078730 Mar 08 20:20:03.109773 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 941/1846] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:04.126420 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:04.127027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:04.133248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:04.134200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:04.134960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:04.135397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:04.196666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:04.204558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4955a12e-7455-4b32-838b-e5fd263274de tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081924 Mar 08 20:20:04.205128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 906/1847] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:05.221939 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:05.222542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:05.229269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:05.229714 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:05.230463 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:05.230889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:05.288756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:05.297907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a0bc7130-e477-4a8f-908b-2cfc2c193a00 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079742 Mar 08 20:20:05.298471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 942/1848] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:06.314558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:06.315153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:06.322004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:06.322455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:06.323221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:06.323655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:06.387586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:06.395520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0cde2040-11dd-4293-aed5-a83f70d9dde8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084808 Mar 08 20:20:06.396086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 907/1849] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:07.413525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:07.414229 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:07.421116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:07.421573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:07.422340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:07.422801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:07.492883 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:07.500604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4c59f3ac-fdb0-4af0-a81b-8167fa86ee18 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.090797 Mar 08 20:20:07.501169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 943/1850] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:08.517296 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:08.518002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:08.525281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:08.525725 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:08.526563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:08.527005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:08.586013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:08.594279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e67cde77-1dbd-4387-bc20-3b1494cf4046 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081086 Mar 08 20:20:08.594828 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 908/1851] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:09.611359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:09.612588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:09.620904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:09.621469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:09.622319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:09.622828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:09.684535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:09.692165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bd318520-d16c-4893-8e8a-960106eedf1c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085372 Mar 08 20:20:09.692753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 944/1852] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:10.709487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:10.710095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:10.716808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:10.717249 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:10.718002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:10.718428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:10.776759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:10.784241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c1740d22-25d2-4d51-b8b2-966badde148e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078520 Mar 08 20:20:10.784814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 909/1853] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:11.800533 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:11.801183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:11.807915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:11.808398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:11.809168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:11.809606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:11.867247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:11.875449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f2822fe6-e62b-4067-8070-985b7b29d67d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078681 Mar 08 20:20:11.876037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 945/1854] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:12.892122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:12.892753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:12.898963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:12.899412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:12.900176 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:12.900636 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:12.961113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:12.968802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a9ad0f98-5446-4469-a17f-151259a0f279 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080638 Mar 08 20:20:12.969295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 910/1855] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:20:13.985001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:13.985614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:13.991795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:13.992249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:13.993672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:13.994110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:14.051365 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:14.059576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a112186a-0e19-4e38-8aeb-e3de99d948ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078382 Mar 08 20:20:14.060131 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 946/1856] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:15.075849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:15.076491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:15.082664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:15.083123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:15.083888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:15.084346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:15.144461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:15.152685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a62a6e1e-1355-42ac-81e4-5133153c2cec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080623 Mar 08 20:20:15.153240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 911/1857] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:16.168926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:16.169530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:16.175708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:16.176158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:16.176950 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:16.177387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:16.235468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:16.243035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9275a072-f941-418a-b05e-0673ad6a0d36 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077990 Mar 08 20:20:16.243590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 947/1858] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:17.260150 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:17.260734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:17.267199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:17.267640 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:17.268427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:17.268857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:17.327280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:17.334870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3c649458-7d8d-491f-9379-6eb1214274b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079256 Mar 08 20:20:17.335425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 912/1859] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:18.351431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:18.352036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:18.358659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:18.359111 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:18.359881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:18.360342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:18.418616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:18.426240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2369827f-1c1c-4ba7-b25b-ede3425f6870 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078652 Mar 08 20:20:18.426808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 948/1860] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:19.441846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:19.442391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:19.448595 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:19.449045 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:19.449805 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:19.450239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:19.508214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:19.516457 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a1d709d6-4afd-4f57-9519-bfd124a798fb tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078079 Mar 08 20:20:19.516605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 913/1861] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:20.533041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:20.533612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:20.540772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:20.541223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:20.541978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:20.542409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:20.600052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:20.608315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-69bce58c-3720-4c0d-826d-bdac4795804e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079159 Mar 08 20:20:20.608864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 949/1862] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:21.625001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:21.625610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:21.632006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:21.632419 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:21.633209 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:21.633680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:21.695976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:21.703709 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a7f42553-d353-4838-84ad-dd22035de00c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082728 Mar 08 20:20:21.704273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 914/1863] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:22.720824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:22.721412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:22.727522 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:22.727970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:22.728763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:22.729200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:22.792400 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:22.799930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-046c7604-f554-420a-8589-9bff3c15abd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083024 Mar 08 20:20:22.800533 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 950/1864] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:23.817006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:23.817645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:23.823914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:23.824395 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:23.825167 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:23.825610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:23.884139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:23.892104 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eb0dc1a5-9a66-4b3d-9094-68f3c3c6dc68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078974 Mar 08 20:20:23.892693 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 915/1865] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:24.907753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:24.908385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:24.914599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:24.915048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:24.915815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:24.916248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:24.973876 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:24.981494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6c581fcd-286d-4ce4-aecc-ab47666bf4b5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077644 Mar 08 20:20:24.982054 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 951/1866] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:25.998459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:25.999064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:26.005082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:26.005538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:26.006304 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:26.006744 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:26.064393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:26.073950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fff70905-b7ba-4f2f-9bec-79d223e20e1b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079116 Mar 08 20:20:26.074752 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 916/1867] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:27.090804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:27.091393 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:27.098008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:27.098453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:27.099209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:27.099643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:27.159366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:27.166803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ed8addbe-6d76-42fe-8ae3-135cd0853edc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079834 Mar 08 20:20:27.167354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 952/1868] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:20:28.183490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:28.184097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:28.190417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:28.190870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:28.191638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:28.192095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:28.250363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:28.258059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cf83a1a8-a844-45d1-8c22-052c4272a330 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078999 Mar 08 20:20:28.258622 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 917/1869] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:29.275710 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:29.276324 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:29.282476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:29.282920 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:29.283674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:29.284104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:29.342500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:29.350080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7dd3ab66-c53e-4201-b249-a4f5bb7dc9d6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078744 Mar 08 20:20:29.350638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 953/1870] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:30.367955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:30.368630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:30.374798 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:30.375281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:30.376055 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:30.376528 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:30.440737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:30.448418 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7d959b11-b862-4eb0-8850-ca4e28910767 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085057 Mar 08 20:20:30.448975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 918/1871] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:31.465212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:31.465779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:31.471877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:31.472353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:31.473117 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:31.473546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:31.531962 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:31.539606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-71a84785-7334-47c0-a318-cc5f7b41a4d1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078367 Mar 08 20:20:31.540155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 954/1872] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:32.556524 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:32.557167 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:32.563385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:32.563869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:32.564667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:32.565109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:32.624307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:32.632071 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-26a8f901-39de-447d-9895-3c2f31f70238 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079939 Mar 08 20:20:32.632703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 919/1873] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:33.649412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:33.650047 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:33.656230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:33.656705 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:33.657466 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:33.657896 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:33.726776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:33.734396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e6da8820-471f-4a69-93f9-2f83aa1bab93 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.089429 Mar 08 20:20:33.734944 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 955/1874] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:34.750911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:34.751535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:34.758101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:34.758545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:34.759295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:34.759724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:34.817843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:34.825859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-54f52603-8bd3-4293-99de-ff819d34dc37 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078768 Mar 08 20:20:34.826411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 920/1875] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:35.842763 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:35.843364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:35.849622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:35.850076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:35.850842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:35.851310 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:35.913875 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:35.921594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b7a98427-9b36-4ced-bb69-ce848b549d8f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082690 Mar 08 20:20:35.922154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 956/1876] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:36.938699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:36.939317 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:36.945649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:36.946103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:36.946874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:36.947315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:37.005293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:37.013464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-82019027-b04f-4520-880b-71812ed352dd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078660 Mar 08 20:20:37.014019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 921/1877] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:20:38.030634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:38.031313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:38.039768 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:38.040626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:38.041803 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:38.042468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:38.116616 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:38.124554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-04b05f1e-a5f3-4182-b7bd-176f9c1df9c3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.097714 Mar 08 20:20:38.125126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 957/1878] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:39.141782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:39.142397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:39.149522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:39.149973 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:39.150737 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:39.151170 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:39.212154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:39.220023 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fcbc20d0-98f3-44a8-bdd8-aaf71201f670 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082338 Mar 08 20:20:39.220612 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 922/1879] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:40.236812 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:40.237441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:40.244359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:40.244801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:40.245555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:40.245983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:40.303182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:40.311386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7d8d64b1-5c4b-4d86-ad86-3ce3314a3bf0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078400 Mar 08 20:20:40.311971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 958/1880] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:41.327862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:41.329131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:41.335871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:41.336417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:41.337192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:41.337634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:41.396734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:41.405133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-aae7c5bd-8783-48bc-85b3-973cdaac9cda tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081171 Mar 08 20:20:41.405690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 923/1881] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:42.421739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:42.422272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:42.428433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:42.428899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:42.429649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:42.430078 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:42.491435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:42.499161 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4ddeda3b-2697-4ebb-8a21-2eeff84fb71f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081306 Mar 08 20:20:42.499716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 959/1882] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:43.488038 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:20:43.488784 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:20:43.516476 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:43.517121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:43.523439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:43.523893 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:43.524707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:43.525148 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:43.585412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:43.593367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6fcd77b0-3897-47c0-b89c-3a8ec55eeab5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081087 Mar 08 20:20:43.593933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 924/1883] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:44.609990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:44.610592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:44.617453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:44.617886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:44.618636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:44.619064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:44.677942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:44.686181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9637e629-4eb4-488b-97bd-9126df03422a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080054 Mar 08 20:20:44.686746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 960/1884] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:45.702854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:45.703462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:45.709742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:45.710674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:45.711459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:45.711896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:45.773280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:45.781543 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d5ce0a76-51c6-4bad-a319-bac8e58acd6a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082565 Mar 08 20:20:45.782240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 925/1885] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:46.798693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:46.799409 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:46.806174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:46.806632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:46.807423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:46.807865 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:46.873036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:46.878244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ac93f84f-8a18-4ecf-be23-2d9b294d5ba0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083253 Mar 08 20:20:46.878908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 961/1886] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:47.894931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:47.895486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:47.902379 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:47.902838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:47.903616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:47.904051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:47.965754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:47.973499 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-14661a2e-6897-437b-a561-5476c28f9381 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082620 Mar 08 20:20:47.974051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 926/1887] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:48.989245 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:48.989948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:48.996566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:48.997101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:48.997976 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:48.998500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:49.062516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:49.070854 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a8aa02d5-d7c9-4632-8e96-995cc7005766 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085410 Mar 08 20:20:49.071420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 962/1888] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:50.087102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:50.087799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:50.102182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:50.102575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:50.103419 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:50.104128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:50.477389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:50.485187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cc04e4f3-6d09-4f02-be25-d635fa207ba9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.401927 Mar 08 20:20:50.485745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 927/1889] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:50.802330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:20:50.802543 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:20:51.502266 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:51.502905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:51.509604 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:51.510057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:51.510823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:51.511259 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:51.571742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:51.579384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b27d7f2f-c4cf-4ad1-baaf-d20782ad221f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081019 Mar 08 20:20:51.579952 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 963/1890] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:52.596764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:52.597378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:52.605799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:52.606261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:52.607269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:52.608052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:52.666960 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:52.674521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-896e654b-9cae-4ad8-82a5-bd2d4a4e99b0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081612 Mar 08 20:20:52.675077 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 928/1891] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:53.690956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:53.691545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:53.697844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:53.698299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:53.699065 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:53.699502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:53.757292 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:53.765229 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5063a44c-694b-4f52-8149-5234dc5f750a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078188 Mar 08 20:20:53.765788 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 964/1892] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:54.781816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:54.782365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:54.788664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:54.789119 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:54.789883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:54.790322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:54.847725 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:54.855321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a83f197f-9bad-4277-8ce2-7798f449348e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077487 Mar 08 20:20:54.855876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 929/1893] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:55.871811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:55.872455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:55.878708 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:55.879218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:55.879987 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:55.880456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:55.938308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:55.946399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e39aa5fb-1d5b-46ff-bfb7-00999874c714 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078425 Mar 08 20:20:55.946958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 965/1894] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:56.963473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:56.964087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:56.969984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:56.970433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:56.971191 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:56.971629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:57.028870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:57.036422 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c09df063-f334-49c3-8970-e39aa4902f9a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077446 Mar 08 20:20:57.036975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 930/1895] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:58.053270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:58.054383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:58.060263 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:58.060746 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:58.061511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:58.061948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:58.120133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:58.128414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-adf4fa6d-8122-4d6b-abd7-d4db9331ed8d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079146 Mar 08 20:20:58.128967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 966/1896] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:20:59.145321 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:20:59.145938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:20:59.152871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:59.153330 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:59.154102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:20:59.154547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:20:59.217067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:20:59.224868 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c6a18885-e4c9-4c4b-95fa-ec62e94b6885 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083539 Mar 08 20:20:59.225460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 931/1897] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:20:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:00.240443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:00.241076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:00.247380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:00.247832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:00.248637 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:00.249077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:00.307250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:00.314846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b266e82a-7b80-41a9-bb5c-aea42ecef97f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078249 Mar 08 20:21:00.315399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 967/1898] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:01.330853 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:01.331462 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:01.338304 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:01.338750 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:01.339511 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:01.339950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:01.398421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:01.406028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3b11ee53-acd6-4043-b677-83304b1e2b57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079040 Mar 08 20:21:01.406598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 932/1899] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:02.422664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:02.423236 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:02.430095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:02.430545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:02.431308 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:02.431770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:02.498137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:02.506136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9ae9302b-b52c-4c8f-970b-d7dbceb1bcb7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.087419 Mar 08 20:21:02.507359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 968/1900] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:03.523589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:03.524151 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:03.531211 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:03.531670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:03.532451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:03.532882 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:03.592124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:03.599763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-eb6a205a-d91e-4eb4-b3d5-a9b266b61b64 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080134 Mar 08 20:21:03.600356 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 933/1901] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:04.616866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:04.617469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:04.623642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:04.624081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:04.624874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:04.625304 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:04.688735 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:04.697856 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8324814b-1738-4022-98cf-2e811b576c62 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085389 Mar 08 20:21:04.698411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 969/1902] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:05.714442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:05.715052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:05.721343 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:05.721799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:05.722565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:05.723003 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:05.782642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:05.790812 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5bb1473a-9e9a-4cb4-a288-397599bd0ec3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080236 Mar 08 20:21:05.791370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 934/1903] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:06.808183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:06.808866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:06.815020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:06.815473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:06.816234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:06.816691 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:06.876138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:06.884501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4e95e1ee-00ad-4ec2-97b3-6b883da8e68c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080138 Mar 08 20:21:06.885056 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 970/1904] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:07.901983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:07.902597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:07.908930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:07.909385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:07.910154 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:07.910597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:07.967988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:07.975718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d727e6c3-c545-4eaf-9368-894fc7b2ac57 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077606 Mar 08 20:21:07.976273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 935/1905] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:08.992269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:08.992925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:08.999138 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:08.999588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:09.000380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:09.000820 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:09.218015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:09.226420 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-988911c3-43e8-419f-9372-6fbe7bb38b0a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.237988 Mar 08 20:21:09.226974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 971/1906] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:10.242780 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:10.243393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:10.249492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:10.249950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:10.250725 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:10.251163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:10.314116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:10.322704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-60ecaa22-e3e7-46e8-b3d3-252aff273a82 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083713 Mar 08 20:21:10.328815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 936/1907] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:11.338657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:11.340762 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:11.347247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:11.347697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:11.348581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:11.349002 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:11.409479 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:11.417248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2381da7b-52e1-4d13-b727-507a6b9bc855 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082382 Mar 08 20:21:11.417796 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 972/1908] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:12.433649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:12.434262 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:12.440417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:12.440874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:12.441642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:12.442074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:12.502048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:12.510282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-260b31c0-b7b4-4da8-a7e9-4b317d868230 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080405 Mar 08 20:21:12.510831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 937/1909] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:13.527435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:13.528042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:13.534286 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:13.534738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:13.535506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:13.535942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:13.594075 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:13.602312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-070f3863-e250-4bc3-af7a-e68011da14ce tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078966 Mar 08 20:21:13.602857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 973/1910] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:14.618546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:14.619159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:14.625431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:14.625889 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:14.626661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:14.627099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:14.686957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:14.694816 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e7cacbd9-baa3-4b25-a492-8090e0e1bbf2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080791 Mar 08 20:21:14.695376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 938/1911] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:15.710759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:15.711356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:15.717529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:15.717973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:15.718726 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:15.719154 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:15.781021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:15.788642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2dc4f8d4-031f-4722-a0d5-20788430a8f1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081650 Mar 08 20:21:15.789224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 974/1912] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:16.805102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:16.805705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:16.812006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:16.812498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:16.813266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:16.813706 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:16.871679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:16.879297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c7e2cdbc-2204-4407-8715-a9480f67d1b8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078012 Mar 08 20:21:16.879859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 939/1913] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:17.896651 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:17.897250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:17.903379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:17.903827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:17.904613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:17.905046 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:17.963085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:17.970589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-28d8e44b-9d7e-409d-9d36-128d0e78a7e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077702 Mar 08 20:21:17.971140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 975/1914] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:18.987820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:18.988433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:18.995209 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:18.995655 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:18.996447 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:18.996930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:19.058152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:19.065754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-efdb4b57-2215-414e-b980-9a1cb7835987 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081835 Mar 08 20:21:19.066309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 940/1915] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:21:20.082694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:20.083302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:20.090186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:20.090640 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:20.091410 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:20.091846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:20.150512 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:20.158084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-95985125-9a56-4b09-ad1f-eb8615a5ee3f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079165 Mar 08 20:21:20.158630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 976/1916] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:21.174599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:21.175207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:21.181460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:21.181902 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:21.182657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:21.183084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:21.241441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:21.249091 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-79181d20-70a2-42a9-99ac-7fbccb4b4dca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078369 Mar 08 20:21:21.249642 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 941/1917] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:22.265996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:22.266529 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:22.273305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:22.273750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:22.274520 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:22.274955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:22.333435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:22.341749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5d4389a4-5f35-4933-80c6-0502d08d42e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079891 Mar 08 20:21:22.342303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 977/1918] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:23.358412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:23.359032 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:23.365789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:23.366251 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:23.367021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:23.367461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:23.425563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:23.433764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e17e5e17-34a3-4105-a0e9-923dc0611732 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079467 Mar 08 20:21:23.434324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 942/1919] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:24.449681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:24.450242 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:24.456550 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:24.457000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:24.457761 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:24.458195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:24.518463 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:24.526203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d87a02e8-cb3e-45bc-9a14-3d3d53592d26 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080481 Mar 08 20:21:24.526752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 978/1920] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:25.542899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:25.543438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:25.549757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:25.550208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:25.550981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:25.551425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:25.610698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:25.618515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a773a2d0-c17f-431c-a27d-48f1c81cabdf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079520 Mar 08 20:21:25.619083 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 943/1921] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:26.635545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:26.636169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:26.642369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:26.642824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:26.643595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:26.644036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:26.701429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:26.708991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f4429b67-509a-4c5f-990c-f4600d240fb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077632 Mar 08 20:21:26.709546 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 979/1922] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:27.725826 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:27.726365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:27.732555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:27.733006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:27.733763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:27.734194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:27.796866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:27.804495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-125bf599-ade3-455f-9215-b7412c771d84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083097 Mar 08 20:21:27.805047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 944/1923] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:28.820980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:28.821570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:28.827771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:28.828214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:28.828998 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:28.829433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:28.891246 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:28.899934 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bde0a46d-39ed-4f60-8d41-b55fa5179e01 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083203 Mar 08 20:21:28.900744 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 980/1924] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:29.918043 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:29.918661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:29.924857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:29.925309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:29.926080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:29.926519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:29.984064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:29.992198 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1b3d59be-92d7-436a-b248-fb91faa63943 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078089 Mar 08 20:21:29.992789 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 945/1925] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:31.008590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:31.009195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:31.015559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:31.016003 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:31.016807 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:31.017234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:31.075262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:31.082778 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6f510b0c-dd65-4e78-b8b0-2381e5256a5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078017 Mar 08 20:21:31.083325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 981/1926] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:32.100431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:32.101049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:32.107275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:32.107720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:32.108520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:32.108959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:32.168051 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:32.175890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-554218c0-650a-49ae-a4b8-53b5c1c035c4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079895 Mar 08 20:21:32.176491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 946/1927] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:33.193015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:33.193663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:33.199868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:33.200350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:33.201121 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:33.201559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:33.259635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:33.267553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-79f2e6a9-aa8d-40a2-bb1c-72d3b2d54186 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078374 Mar 08 20:21:33.268112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 982/1928] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:34.284277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:34.284914 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:34.291208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:34.291674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:34.292465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:34.292910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:34.354047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:34.362248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5d862a4b-4e62-49fd-bae7-b085bdc1872f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081909 Mar 08 20:21:34.362862 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 947/1929] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:35.379666 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:35.380253 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:35.386631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:35.387353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:35.388120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:35.388592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:35.446267 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:35.453976 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f75a368c-0ac3-472c-b3e0-575fa8eba253 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078323 Mar 08 20:21:35.454534 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 983/1930] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:36.471044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:36.471589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:36.478313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:36.478763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:36.479523 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:36.479963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:36.541116 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:36.548734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1796a70f-1b3d-4e3f-a664-42b695337d50 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081618 Mar 08 20:21:36.549293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 948/1931] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:37.566036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:37.566579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:37.572881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:37.573335 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:37.574103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:37.574541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:37.633430 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:37.641414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-51748d06-0fcf-4519-aefe-6a465ac115f8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079327 Mar 08 20:21:37.641968 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 984/1932] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:38.657672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:38.658307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:38.664556 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:38.665005 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:38.665758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:38.666186 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:38.724674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:38.732572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c1cf30f9-6195-4c14-8692-ede69da12d88 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078808 Mar 08 20:21:38.733131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 949/1933] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:39.749248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:39.749858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:39.756694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:39.757151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:39.757915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:39.758350 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:39.815859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:39.824369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-067b6292-ab08-43d7-806f-ee63d24fa8e7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078984 Mar 08 20:21:39.824922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 985/1934] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:40.840808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:40.841405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:40.847636 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:40.848084 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:40.848865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:40.850048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:40.908047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:40.916048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a878dcc3-e320-4ead-a52d-affbb425c149 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079077 Mar 08 20:21:40.916649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 950/1935] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:41.933037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:41.933648 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:41.939955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:41.940442 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:41.941214 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:41.941655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:42.003979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:42.012076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d165ac72-8c19-4207-834f-446ae5e9fa70 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082608 Mar 08 20:21:42.012687 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 986/1936] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:43.028986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:43.029593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:43.035802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:43.036258 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:43.037074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:43.037509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:43.096664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:43.104803 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-83b0edbe-1d47-46d0-b11e-4e8906a07608 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079756 Mar 08 20:21:43.105367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 951/1937] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:44.121824 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:44.122430 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:44.128673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:44.129123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:44.129882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:44.130316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:44.187991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:44.195672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d047ebf4-d407-4d15-99ec-33670495eaab tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077715 Mar 08 20:21:44.196226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 987/1938] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:45.213662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:45.214261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:45.220525 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:45.220973 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:45.221727 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:45.222156 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:45.283101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:45.291475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-97b05686-47e5-49bf-8d8a-b70cc761f52a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083826 Mar 08 20:21:45.292031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 952/1939] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:46.307928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:46.308564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:46.314759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:46.315206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:46.315966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:46.316433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:46.374066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:46.382158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-86c3d1f2-8edb-4f29-aba3-6a7b4c3794d5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078140 Mar 08 20:21:46.382715 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 988/1940] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:47.398530 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:47.399049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:47.405346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:47.405796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:47.406553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:47.406990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:47.465861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:47.473538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-53977b91-5809-4c47-abc9-f4b4672c4c85 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078961 Mar 08 20:21:47.474672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 953/1941] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:48.490782 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:48.491369 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:48.497626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:48.498080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:48.498847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:48.499288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:48.557695 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:48.565294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f1eb440b-926c-41f2-b8ff-779c4d68b195 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078447 Mar 08 20:21:48.565857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 989/1942] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:49.582404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:49.583018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:49.589328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:49.589782 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:49.590554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:49.590991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:49.650299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:49.658079 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d6649e34-3f30-403a-993b-eed7e9cff545 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079639 Mar 08 20:21:49.658634 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 954/1943] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:50.674923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:50.675507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:50.682413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:50.682857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:50.683642 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:50.684108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:50.754269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:50.762779 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1e180068-37ca-46f9-9c8a-a66b60288199 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.091646 Mar 08 20:21:50.763343 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 990/1944] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:51.779097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:51.779736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:51.791027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:51.791486 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:51.792268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:51.792722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:51.863466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:51.871250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0e8dfa5f-9eb2-4335-9167-5238523298ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.096165 Mar 08 20:21:51.880198 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 955/1945] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:51 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:52.887126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:52.887739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:52.894285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:52.894736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:52.895511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:52.895942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:52.955463 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:52.963227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bb4d4cb4-e062-496b-a85e-4c4d1a865777 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080220 Mar 08 20:21:52.963765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 991/1946] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:53.979380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:53.980593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:53.986845 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:53.987301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:53.988071 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:53.988538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:54.050784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:54.058596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-745a64a3-7914-49d1-b706-61231613b02e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083072 Mar 08 20:21:54.059162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 956/1947] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:55.075991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:55.078099 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:55.087397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:55.087957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:55.088664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:55.089104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:55.164771 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:55.172729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a9cb4cf1-9fe1-4927-b50f-b39bbba0ced0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.100936 Mar 08 20:21:55.173297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 992/1948] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:56.193567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:56.194178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:56.199873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:56.200351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:56.201127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:56.201563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:56.264490 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:56.272163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4a595074-fb07-4a1d-8484-8ae1889c064e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082584 Mar 08 20:21:56.272743 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 957/1949] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:57.289171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:57.289802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:57.296349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:57.297186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:57.298589 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:57.299398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:57.373483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:57.381794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fbdebfb4-e027-4531-b773-6a9d1e9d14ca tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.096539 Mar 08 20:21:57.382383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 993/1950] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:58.400851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:58.401506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:58.409518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:58.410177 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:58.411464 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:58.412221 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:58.482753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:58.492715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-05f58fc2-af01-4218-a538-986c47ae2b87 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.096260 Mar 08 20:21:58.493299 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 958/1951] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:21:59.509390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:21:59.510093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:21:59.516497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:59.516946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:59.517718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:21:59.518151 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:21:59.576930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:21:59.585180 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c18456da-d1b2-4614-a3e1-ee46e3e0f168 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079885 Mar 08 20:21:59.585736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 994/1952] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:21:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:00.602320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:00.602925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:00.609174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:00.609620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:00.610392 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:00.610824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:00.669266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:00.677505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-170e6639-6e41-46a7-abc1-a4de8aeb4bc5 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079104 Mar 08 20:22:00.678063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 959/1953] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:01.693720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:01.694285 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:01.700493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:01.700951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:01.701750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:01.702192 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:01.760179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:01.768057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-15bf2159-8d83-4dad-9bd3-1b4919df0478 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078246 Mar 08 20:22:01.768654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 995/1954] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:02.785712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:02.786253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:02.792475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:02.792930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:02.793689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:02.794124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:02.855125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:02.862986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2d7cf25a-1be1-4037-b031-57379c19e525 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081320 Mar 08 20:22:02.863539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 960/1955] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:02 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:03.879585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:03.880190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:03.886723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:03.887172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:03.887931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:03.888395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:03.946049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:03.953643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-657c1e95-8d40-4b23-9e4d-95b0121d1710 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077899 Mar 08 20:22:03.954195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 996/1956] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:04.970708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:04.971257 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:04.977972 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:04.978413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:04.979165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:04.979596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:05.037627 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:05.045364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f3fa4b7b-30c6-4a11-892b-8a533d74063c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078529 Mar 08 20:22:05.045926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 961/1957] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:06.062646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:06.063200 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:06.070328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:06.070781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:06.071581 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:06.072020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:06.134878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:06.144159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7f18606e-b132-4cde-a183-f0ca7d0f3292 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085420 Mar 08 20:22:06.144752 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 997/1958] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:07.161585 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:07.162232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:07.168758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:07.169214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:07.169998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:07.170436 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:07.232218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:07.240469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-714bba64-35ed-4ef7-8f62-64c37e4e4b0b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083395 Mar 08 20:22:07.241028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 962/1959] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:08.257514 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:08.258118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:08.264605 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:08.265055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:08.265816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:08.266250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:08.327654 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:08.335301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9b60f3f2-0b1d-4650-93d8-9be8a1be9c11 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082224 Mar 08 20:22:08.335858 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 998/1960] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:09.351787 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:09.352428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:09.359056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:09.359510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:09.360301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:09.360745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:09.420824 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:09.429404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1e7fd6bb-32d4-4f5f-bd32-ac900cb3b6e3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081974 Mar 08 20:22:09.429966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 963/1961] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:10.446414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:10.447037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:10.453587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:10.454033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:10.454977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:10.455411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:10.515734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:10.523417 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-55d6d34e-d288-4515-b44d-6dcaa510aecd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081416 Mar 08 20:22:10.523972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 999/1962] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:11.539456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:11.540091 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:11.546440 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:11.546896 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:11.547665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:11.548105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:11.610163 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:11.617842 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b1985e0b-0f03-4e2c-bb23-5c0f8803cf1f tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082845 Mar 08 20:22:11.618427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 964/1963] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:12.633509 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:12.634097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:12.640613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:12.641067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:12.641828 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:12.642264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:12.701584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:12.709838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2f4fff29-f788-4e9b-bb9b-a76390e1192e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080222 Mar 08 20:22:12.710396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1000/1964] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:13.104138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:22:13.104619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:22:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:22:13.726401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:13.727013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:13.733323 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:13.733767 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:13.734552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:13.734987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:13.793288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:13.801739 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b5191317-4d6f-4c84-8aa9-c1b9af7abb12 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078747 Mar 08 20:22:13.802291 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 965/1965] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:13 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:14.818985 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:14.819596 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:14.825884 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:14.826334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:14.827134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:14.827575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:14.885767 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:14.893657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bb8f86f9-5472-4051-96eb-7ee589e3deb9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079096 Mar 08 20:22:14.894223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1001/1966] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:15.910825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:15.911427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:15.917712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:15.918177 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:15.918947 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:15.919387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:15.978351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:15.986008 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-aa50c037-89de-45a4-9a1a-53f9d805b2d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079110 Mar 08 20:22:15.986565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 966/1967] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:17.002559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:17.003149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:17.009988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:17.010436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:17.011469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:17.011908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:17.069496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:17.077102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2a7d4dd1-967d-447b-b2df-e22a8ed9c144 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078439 Mar 08 20:22:17.077664 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1002/1968] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:18.094284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:18.094891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:18.101205 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:18.101654 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:18.102417 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:18.102856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:18.162075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:18.169755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c632c72a-b99b-4122-8202-9f279e760155 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079312 Mar 08 20:22:18.170309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 967/1969] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:19.187033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:19.187643 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:19.198660 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:19.199456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:19.200456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:19.200900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:19.261794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:19.269699 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4b917f6e-cb27-4cb3-b903-d83bec8558c0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.086573 Mar 08 20:22:19.271104 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1003/1970] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:20.287264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:20.287873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:20.294089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:20.294537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:20.295301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:20.295748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:20.356485 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:20.364623 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4a710b8a-e5bb-49c8-940d-a763c4cd002a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081110 Mar 08 20:22:20.365126 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 968/1971] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:21.382344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:21.382895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:21.389383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:21.389838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:21.390606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:21.391045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:21.454203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:21.462525 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6302446b-e7e8-4640-8df1-3df00af8279a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084656 Mar 08 20:22:21.463070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1004/1972] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:22.479557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:22.480113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:22.486500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:22.486955 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:22.487724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:22.488166 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:22.547720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:22.555613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7223cb70-de54-4d35-ac46-9435e3156d5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080015 Mar 08 20:22:22.556172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 969/1973] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:23.572573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:23.573181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:23.579457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:23.579902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:23.580703 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:23.581136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:23.639574 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:23.647216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-461859dc-a2ad-4005-a060-c1b037c49842 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078508 Mar 08 20:22:23.647776 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1005/1974] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:24.663288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:24.663938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:24.670266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:24.670717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:24.671495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:24.671935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:24.732099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:24.740315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-13724a62-5d0d-41a4-9437-550aa43d4fa8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080868 Mar 08 20:22:24.740872 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 970/1975] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:25.756902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:25.757494 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:25.763899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:25.764379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:25.765142 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:25.765575 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:25.823813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:25.831407 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d57921f8-a562-47d2-8c6a-4efd58fda878 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078376 Mar 08 20:22:25.832001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1006/1976] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:25 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:26.849089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:26.849733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:26.855718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:26.856169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:26.856964 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:26.857407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:26.915225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:26.922863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-156e05ac-572f-49d7-b96d-0fd187c1a7e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078152 Mar 08 20:22:26.923414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 971/1977] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:27.940103 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:27.940729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:27.947259 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:27.947707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:27.948500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:27.948942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:28.010539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:28.018610 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-135f9927-f1e2-4635-8b96-ea41687e97fd tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082305 Mar 08 20:22:28.019171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1007/1978] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:29.035378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:29.036001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:29.042337 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:29.042792 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:29.043564 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:29.044002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:29.106035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:29.115363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8c52449f-ccb0-4abf-812a-9e36b8400b84 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084273 Mar 08 20:22:29.115966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 972/1979] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:30.131455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:30.132063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:30.138666 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:30.139118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:30.139895 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:30.140358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:30.200725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:30.209005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8089f169-e0d9-4409-ba1c-d257f5d15be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081370 Mar 08 20:22:30.209558 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1008/1980] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:31.225760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:31.227015 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:31.233302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:31.233761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:31.234543 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:31.234983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:31.299629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:31.307586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-722964f9-43ec-4166-8ef9-120c978061b6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085935 Mar 08 20:22:31.308275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 973/1981] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:32.324624 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:32.325241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:32.331457 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:32.332439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:32.333220 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:32.333659 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:32.392900 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:32.401083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-dcbbbda6-9966-486b-bc90-cd032b629129 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080279 Mar 08 20:22:32.401639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1009/1982] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:33.418052 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:33.418666 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:33.424839 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:33.425297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:33.426648 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:33.427087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:33.485767 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:33.494070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ffc2410d-92cc-48e9-ac58-c91b8b87d9e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079831 Mar 08 20:22:33.494625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 974/1983] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:34.511723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:34.512535 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:34.519052 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:34.519996 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:34.520802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:34.521238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:34.585021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:34.592700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-80ca4e88-c970-452d-b4ea-a429757f0400 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085496 Mar 08 20:22:34.593260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1010/1984] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:35.609667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:35.610307 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:35.617297 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:35.617749 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:35.618516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:35.618951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:35.677176 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:35.684713 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-435c4d09-3944-42d8-83b3-6def036e7898 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078870 Mar 08 20:22:35.685268 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 975/1985] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:36.701992 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:36.702597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:36.709445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:36.709892 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:36.710661 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:36.711091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:36.771372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:36.778973 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1f71585d-78b3-4506-bdcf-5472092f64e9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081344 Mar 08 20:22:36.779526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1011/1986] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:37.796157 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:37.796800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:37.803135 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:37.803586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:37.804386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:37.804827 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:37.865869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:37.873460 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a77c3779-7b8d-4c82-b5c8-7d8d8ec59f16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081115 Mar 08 20:22:37.874018 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 976/1987] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:37 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:38.890562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:38.891172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:38.897379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:38.897835 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:38.898601 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:38.899037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:38.958281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:38.965851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bcb47450-df2b-4a9d-b20c-2ecd12afc67e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079089 Mar 08 20:22:38.966416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1012/1988] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:39.000951 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:22:39.001087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:22:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:22:39.982982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:39.983729 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:39.990082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:39.990534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:39.991313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:39.991756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:40.053539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:40.061492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e6d1f7b1-a317-4bfd-aadc-823f104b2127 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082473 Mar 08 20:22:40.062055 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 977/1989] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:41.083534 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:41.084176 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:41.090406 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:41.090857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:41.091625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:41.092063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:41.151239 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:41.158893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-90e14c8d-2692-4026-b7cc-888a059cc692 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079816 Mar 08 20:22:41.159456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1013/1990] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:42.175583 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:42.176115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:42.182442 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:42.182884 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:42.183638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:42.184067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:42.242757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:42.250288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5f8c489a-0a84-4125-9568-268fa5aa10ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078624 Mar 08 20:22:42.250838 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 978/1991] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:43.267084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:43.267685 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:43.273905 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:43.274347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:43.275106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:43.275540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:43.333398 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:43.341071 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6a155572-81b9-41bf-b87f-7eae21e07318 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077801 Mar 08 20:22:43.341645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1014/1992] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:44.358239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:44.358854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:44.365109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:44.365562 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:44.366326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:44.366765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:44.424895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:44.432783 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b0878e02-1b9b-458e-8224-f980a3e2bac7 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078544 Mar 08 20:22:44.433350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 979/1993] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:45.448727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:45.449277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:45.455547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:45.456000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:45.456848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:45.457296 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:45.521374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:45.529035 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ddb5f841-f96a-42e6-8d1c-1e474008f6ed tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084321 Mar 08 20:22:45.529804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1015/1994] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:46.546189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:46.546722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:46.553465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:46.553916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:46.554677 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:46.555112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:46.616229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:46.623962 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-91f6fa49-2842-4974-afd9-a680931aea16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081749 Mar 08 20:22:46.624556 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 980/1995] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:47.641489 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:47.642097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:47.648372 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:47.648829 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:47.649595 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:47.650031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:47.711609 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:47.719359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ac7ad76f-c8c7-4050-83e4-71953535d2e8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081736 Mar 08 20:22:47.719925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1016/1996] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:48.736571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:48.737127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:48.743479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:48.743922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:48.744706 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:48.745136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:48.803143 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:48.810689 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8d0bda71-28b1-4ac4-9fca-eddbcb50ec16 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078069 Mar 08 20:22:48.811237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 981/1997] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:49.827340 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:49.827946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:49.834889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:49.835555 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:49.836838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:49.836838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:49.900971 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:49.908606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-efc11af7-3699-43c3-b869-aa3e3b099604 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085160 Mar 08 20:22:49.909177 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1017/1998] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:49 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:50.926059 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:50.927073 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:50.933733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:50.934179 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:50.934946 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:50.935380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:50.993714 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:51.001441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b29cb7f8-fd82-4950-99ec-053018061130 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079986 Mar 08 20:22:51.002001 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 982/1999] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:50 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:22:52.017376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:52.018010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:52.024863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:52.025312 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:52.026080 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:52.026516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:52.084819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:52.096717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2b579e8e-f869-4646-b3d0-2defebc31e68 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083152 Mar 08 20:22:52.097294 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1018/2000] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:22:53.115318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:53.116495 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:53.123266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:53.123748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:53.124551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:53.124986 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:53.186963 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:53.195206 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bbb8c573-8e0e-409c-80dc-c1c045defb52 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084027 Mar 08 20:22:53.195774 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 983/2001] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:53 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:54.212519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:54.213122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:54.219445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:54.219888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:54.220667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:54.221096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:54.284131 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:54.292587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7e025849-33e5-433a-8751-5eed8cbf7c1e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084023 Mar 08 20:22:54.293146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1019/2002] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:54 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:55.309393 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:55.310022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:55.316352 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:55.316813 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:55.317582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:55.318019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:55.378919 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:55.386935 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a32912c1-131f-4e30-98a2-321566925eb0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081468 Mar 08 20:22:55.387502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 984/2003] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:55 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:55.816493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:55.816997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:55.822989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:55.823441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:55.824210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:55.824673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:55.838084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance 5a53ea32-1838-4dd1-85b7-bae137389683 could not be found. Mar 08 20:22:55.838673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance 5a53ea32-1838-4dd1-85b7-bae137389683 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:22:55.839478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4c3aca47-b235-47c1-ab0c-174f82632d9e tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 404 len: 111 microversion: 2.1 time: 0.027357 Mar 08 20:22:55.839995 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1020/2004] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:22:55 2022] DELETE /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:22:55.847889 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:55.848522 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] [instance: 5a53ea32-1838-4dd1-85b7-bae137389683] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:55.854289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:55.854736 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:55.855498 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:55.855932 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:55.869411 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] HTTP exception thrown: Instance 5a53ea32-1838-4dd1-85b7-bae137389683 could not be found. Mar 08 20:22:55.869982 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] Returning 404 to user: Instance 5a53ea32-1838-4dd1-85b7-bae137389683 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:22:55.870775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ee022212-4122-4d03-8f5f-9dca835d35f9 tempest-AttachVolumeNegativeTest-828596423 tempest-AttachVolumeNegativeTest-828596423-project] 10.222.0.45 "GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683" status: 404 len: 111 microversion: 2.1 time: 0.026842 Mar 08 20:22:55.871282 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 985/2005] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:55 2022] GET /compute/v2.1/servers/5a53ea32-1838-4dd1-85b7-bae137389683 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:22:56.404391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:56.405004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:56.410919 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:56.411371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:56.412147 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:56.412612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:56.499603 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:56.508159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-00014e0c-c2d0-4668-939e-3544ac5b1379 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.107634 Mar 08 20:22:56.508823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1021/2006] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:56 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:57.525136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:57.525751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:57.532036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:57.532599 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:57.533375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:57.534013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:57.601339 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:57.611035 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-af44ce3d-0107-4ff7-b3df-c224b484a68b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.089224 Mar 08 20:22:57.622384 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 986/2007] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:57 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:58.630346 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:58.631785 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:58.638750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:58.639513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:58.640402 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:58.641005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:58.717167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:58.725717 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-38ca0511-f34f-4a8c-8e57-c52685ac0197 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.099569 Mar 08 20:22:58.726702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1022/2008] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:58 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:22:59.742383 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:22:59.742994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:22:59.749260 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:59.749719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:59.750492 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:22:59.750928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:22:59.811569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:22:59.821487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-14eabd14-7cb1-4f3c-9f7d-5a194a5773d4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082817 Mar 08 20:22:59.830870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 987/2009] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:22:59 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:00.328579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-baf9a42c-4c77-4ba3-bf3a-ee1503e74270 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Action: 'create', calling method: .version_select at 0x7f070498ad30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-413329611", "metadata": {"Type": "work"}}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:23:00.330010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-baf9a42c-4c77-4ba3-bf3a-ee1503e74270 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:00.330810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-baf9a42c-4c77-4ba3-bf3a-ee1503e74270 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.118834 Mar 08 20:23:00.331376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1023/2010] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Mar 8 20:23:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:23:00.340431 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-206e1808-c390-49e1-a105-779d782654f3 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Action: 'create', calling method: .version_select at 0x7f070502f280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1271485935", "metadata": {"Type": "work"}}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:23:00.341894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-206e1808-c390-49e1-a105-779d782654f3 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:00.342686 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-206e1808-c390-49e1-a105-779d782654f3 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006185 Mar 08 20:23:00.343189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 988/2011] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Mar 8 20:23:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 20:23:00.351869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3ac859bf-866d-4b81-9033-34fff3c265f2 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Action: 'create', calling method: .version_select at 0x7f0704998ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1920770863", "metadata": {"Type": "work"}}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:23:00.353063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3ac859bf-866d-4b81-9033-34fff3c265f2 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:00.353837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3ac859bf-866d-4b81-9033-34fff3c265f2 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005645 Mar 08 20:23:00.355064 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1024/2012] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Mar 8 20:23:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 20:23:00.363559 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3c9fe55f-0ca3-48c4-8cc4-6434ec2305fc tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Calling method '.version_select at 0x7f0704ff0dc0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:00.389775 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-3c9fe55f-0ca3-48c4-8cc4-6434ec2305fc tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] HTTP exception thrown: Volume tempest-invalid-747891069 could not be found. Mar 08 20:23:00.391030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3c9fe55f-0ca3-48c4-8cc4-6434ec2305fc tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Returning 404 to user: Volume tempest-invalid-747891069 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:00.391835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3c9fe55f-0ca3-48c4-8cc4-6434ec2305fc tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-747891069" status: 404 len: 98 microversion: 2.1 time: 0.032429 Mar 08 20:23:00.392375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 989/2013] 10.222.0.45 () {58 vars in 1214 bytes} [Tue Mar 8 20:23:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-747891069 => generated 98 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 08 20:23:00.401166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-91363905-7823-46c0-ba7c-84187ba5410e tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003838 Mar 08 20:23:00.401658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1025/2014] 10.222.0.45 () {58 vars in 1139 bytes} [Tue Mar 8 20:23:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 20:23:00.410285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4f22732d-dcd8-4f78-b095-4dd3a707ce44 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004056 Mar 08 20:23:00.410766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 990/2015] 10.222.0.45 () {58 vars in 1136 bytes} [Tue Mar 8 20:23:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 20:23:00.418300 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-61a2175d-c9d5-4787-9785-9a2f7d327755 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Calling method '.version_select at 0x7f0709ae55e0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:00.444645 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-61a2175d-c9d5-4787-9785-9a2f7d327755 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] HTTP exception thrown: Volume e21debd7-c8a9-4c21-b692-b99b6653ca1e could not be found. Mar 08 20:23:00.445234 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-61a2175d-c9d5-4787-9785-9a2f7d327755 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Returning 404 to user: Volume e21debd7-c8a9-4c21-b692-b99b6653ca1e could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:00.446048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-61a2175d-c9d5-4787-9785-9a2f7d327755 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/e21debd7-c8a9-4c21-b692-b99b6653ca1e" status: 404 len: 109 microversion: 2.1 time: 0.031085 Mar 08 20:23:00.446591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1026/2016] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 20:23:00 2022] DELETE /compute/v2.1/os-volumes/e21debd7-c8a9-4c21-b692-b99b6653ca1e => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:23:00.455199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9ee528d8-af42-4cef-89c1-e43001dad600 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Calling method '.version_select at 0x7f0704f32430>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:00.480981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-9ee528d8-af42-4cef-89c1-e43001dad600 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] HTTP exception thrown: Volume 59cb76d4-c5c1-4e56-8dcf-5ec76e0b9f32 could not be found. Mar 08 20:23:00.481575 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9ee528d8-af42-4cef-89c1-e43001dad600 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] Returning 404 to user: Volume 59cb76d4-c5c1-4e56-8dcf-5ec76e0b9f32 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:00.482390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9ee528d8-af42-4cef-89c1-e43001dad600 tempest-VolumesNegativeTest-158290272 tempest-VolumesNegativeTest-158290272-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/59cb76d4-c5c1-4e56-8dcf-5ec76e0b9f32" status: 404 len: 109 microversion: 2.1 time: 0.030970 Mar 08 20:23:00.482912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 991/2017] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 20:23:00 2022] GET /compute/v2.1/os-volumes/59cb76d4-c5c1-4e56-8dcf-5ec76e0b9f32 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:23:00.838363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:00.839247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:00.845816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:00.846268 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:00.847273 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:00.847827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:00.918353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:00.926984 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-30bbc15b-22a2-4618-b85c-324b84193c77 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.092679 Mar 08 20:23:00.927548 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1027/2018] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:00 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:01.944071 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:01.944699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:01.950971 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:01.951426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:01.952197 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:01.952661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:02.015504 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:02.023837 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c0bc4da5-4ba7-4f6e-bf56-fed809c2183a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084963 Mar 08 20:23:02.024358 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 992/2019] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:01 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:03.040426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:03.041041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:03.047321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:03.047774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:03.048565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:03.049011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:03.108805 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:03.117748 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bff3e128-d90e-4a4c-9d0b-31c933913146 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080613 Mar 08 20:23:03.117868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1028/2020] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:03 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:04.133722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:04.134329 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:04.140846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:04.141289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:04.142047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:04.142476 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:04.200988 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:04.209338 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d785ed1a-0b0d-4adc-be99-0d6fc961f522 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079780 Mar 08 20:23:04.209894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 993/2021] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:04 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:05.225902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:05.226502 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:05.232421 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:05.232864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:05.233619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:05.234050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:05.295484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:05.303843 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0dec03b0-cee6-43a7-9937-e35884912b2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082183 Mar 08 20:23:05.304426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1029/2022] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:05 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:06.320475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:06.321130 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:06.327455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:06.327904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:06.328699 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:06.329133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:06.395175 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:06.402895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2a8478e2-5a58-44cc-9f7d-332043c70077 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.086229 Mar 08 20:23:06.403452 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 994/2023] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:06 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:07.419795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:07.420434 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:07.427153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:07.427607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:07.428403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:07.428842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:07.495608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:07.507328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1c65f837-ac7c-4321-9f31-27ed9afddea6 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.091172 Mar 08 20:23:07.507936 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1030/2024] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:07 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:08.526278 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:08.526763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:08.533475 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:08.534537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:08.535488 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:08.536138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:08.605753 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:08.614332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d7d037b1-e203-4a25-b396-9ff16223e7da tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.092849 Mar 08 20:23:08.614895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 995/2025] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:08 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:23:09.631534 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:09.632149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:09.638783 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:09.639191 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:09.639954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:09.640411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:09.701195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:09.709071 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d2011af2-9269-41ee-9158-312761ea018a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081909 Mar 08 20:23:09.709634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1031/2026] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:09 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:10.725609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:10.726357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:10.732525 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:10.733048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:10.733718 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:10.734144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:10.793125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:10.800908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-636d19a2-9489-49c1-a5b2-308aa172512c tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079101 Mar 08 20:23:10.801451 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 996/2027] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:10 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:11.817288 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:11.817899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:11.824279 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:11.824765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:11.825613 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:11.826059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:11.884431 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:11.894173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b5354eda-122b-4c3b-ab02-4868ef7e02ba tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080709 Mar 08 20:23:11.894733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1032/2028] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:11 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:12.910602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:12.911212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:12.917491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:12.917942 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:12.918715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:12.919149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:12.980618 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:12.989056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-979c3ce4-a799-4627-a964-f2b123b02d2b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082849 Mar 08 20:23:12.989611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 997/2029] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:12 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:14.005980 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:14.006580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:14.012960 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:14.013403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:14.014163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:14.014590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:14.072186 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:14.079796 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-70c7b509-7c0f-4a8d-afea-4cc94d68ce5d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078128 Mar 08 20:23:14.080367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1033/2030] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:14 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:15.096231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:15.096894 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:15.103115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:15.103576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:15.104362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:15.104811 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:15.163577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:15.171332 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f6c00ca2-dadf-4617-b017-a3926f1fb1be tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078928 Mar 08 20:23:15.171897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 998/2031] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:15 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:16.187888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:16.188526 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:16.194745 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:16.195198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:16.195956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:16.196418 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:16.255166 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:16.263017 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d7b95e47-cfd4-4fa8-b424-fe90e1f0413d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078997 Mar 08 20:23:16.263569 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1034/2032] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:16 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:17.280318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:17.280928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:17.287615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:17.288062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:17.288852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:17.289289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:17.347004 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:17.354678 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-79860d53-def6-4407-a3d7-f73e762bc556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078168 Mar 08 20:23:17.355231 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 999/2033] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:17 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:18.370827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:18.371426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:18.378237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:18.378681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:18.379436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:18.379862 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:18.441480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:18.449209 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8bf73c36-dd12-4b73-ab8d-f88ba78425d8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082197 Mar 08 20:23:18.449755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1035/2034] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:18 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:19.465915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:19.466459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:19.472804 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:19.473253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:19.474014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:19.474502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:19.532482 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:19.540101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b712440a-fd05-4120-b189-3995a07a6be3 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078140 Mar 08 20:23:19.540686 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1000/2035] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:19 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:20.556700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:20.557244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:20.563513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:20.564000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:20.564832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:20.565275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:20.623217 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:20.630837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2b12bef3-941c-400b-bd1f-6c6e70828969 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078139 Mar 08 20:23:20.631396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1036/2036] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:20 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:21.647547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:21.648119 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:21.654364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:21.654821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:21.655589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:21.656031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:21.717300 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:21.725601 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f2b93ac4-fe00-40d9-a763-25bda6df45aa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.082080 Mar 08 20:23:21.726162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1001/2037] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:21 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:22.742955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:22.743513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:22.749734 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:22.750190 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:22.750958 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:22.751397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:22.809194 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:22.817349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cac67de8-b138-4287-876b-146a0cca16c8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078377 Mar 08 20:23:22.817908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1037/2038] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:22 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:23.833888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:23.834503 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:23.840687 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:23.841128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:23.841877 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:23.842301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:23.901070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:23.909849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ed2b37d5-1ea2-40f6-99da-08524eb725f4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079736 Mar 08 20:23:23.910429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1002/2039] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:23 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:24.931093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:24.931693 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:24.937923 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:24.938374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:24.939134 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:24.939568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:24.997672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:25.005820 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ca12c37d-c66c-412f-80db-197bef45725d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078605 Mar 08 20:23:25.006380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1038/2040] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:24 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:26.023453 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:26.024021 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:26.029844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:26.030295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:26.031063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:26.031500 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:26.092091 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:26.099745 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0abf982d-a395-4c25-a671-9094260ab7b1 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080418 Mar 08 20:23:26.100543 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1003/2041] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:26 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:27.116844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:27.117460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:27.123504 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:27.123955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:27.124755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:27.125194 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:27.182919 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:27.190519 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a3972561-7d0a-4258-8b68-db3d7667cdd8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078006 Mar 08 20:23:27.191086 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1039/2042] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:27 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:28.208174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:28.208843 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:28.215271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:28.215724 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:28.216538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:28.216980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:28.280873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:28.288625 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e3e2fcc9-f6c9-4b49-b133-23e08457ad8e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.084860 Mar 08 20:23:28.289189 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1004/2043] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:28 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:29.305813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:29.306427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:29.312679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:29.313133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:29.313907 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:29.314374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:29.372811 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:29.380476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fc392de4-f198-45f5-acd6-eadae29ad683 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078530 Mar 08 20:23:29.381041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1040/2044] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:29 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:30.398037 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:30.398573 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:30.404786 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:30.405228 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:30.405984 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:30.406413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:30.464424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:30.472145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bc2b4b85-401d-4fe6-be8a-9b3f275ca548 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078540 Mar 08 20:23:30.472730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1005/2045] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:30 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:31.488852 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:31.489396 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:31.495622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:31.496073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:31.496863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:31.497298 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:31.562846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:31.570579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-39b126f7-7e89-470f-9f6d-177a27c824fe tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.085682 Mar 08 20:23:31.571130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1041/2046] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:31 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:32.587715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:32.588345 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:32.594629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:32.595080 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:32.595890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:32.596347 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:32.655062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:32.662806 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-1d3e3025-26b2-4baf-8572-8e77514b2528 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078932 Mar 08 20:23:32.663355 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1006/2047] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:32 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:33.679305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:33.679906 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:33.686036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:33.686477 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:33.687240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:33.687668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:33.745203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:33.752791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8d1db9e0-85dc-46e9-9794-91a140a5955d tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.077859 Mar 08 20:23:33.753337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1042/2048] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:33 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:34.769656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:34.770254 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:34.776412 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:34.776860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:34.777621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:34.778048 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:34.836353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:34.843905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7a573ea6-29b4-47fe-891e-1300fa6a7d94 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078111 Mar 08 20:23:34.844494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1007/2049] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:34 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:35.860877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:35.861557 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:35.868157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:35.868630 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:35.869388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:35.869818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:35.929098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:35.937045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-517a3aaa-8c42-4d5b-a2e5-de9c9a6c8ee4 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079597 Mar 08 20:23:35.937607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1043/2050] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:35 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:36.954044 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:36.954653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:36.961491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:36.961939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:36.962700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:36.963133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:37.022444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:37.030113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f04aee7f-2550-482c-b940-9f118630ae5b tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079876 Mar 08 20:23:37.030667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1008/2051] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:36 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:38.046974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:38.047513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:38.053774 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:38.054223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:38.054987 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:38.055423 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:38.116269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:38.123116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-600af6bd-abc5-426c-acd0-469832930556 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080094 Mar 08 20:23:38.123668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1044/2052] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:38 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:39.139176 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:39.139795 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:39.146099 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:39.146552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:39.147316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:39.147757 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:39.208619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:39.216274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3b41780c-c964-48d4-ac00-7c4f07215f5a tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.081279 Mar 08 20:23:39.216891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1009/2053] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:39 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:40.233478 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:40.234112 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:40.241098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:40.241554 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:40.242317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:40.242750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:40.300598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:40.308618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9375a991-1814-4b29-ab5b-30001513dd5e tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079000 Mar 08 20:23:40.309167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1045/2054] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:40 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:41.325110 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:41.325742 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:41.332555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:41.333016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:41.333791 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:41.334229 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:41.392239 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:41.400539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-67e5e150-d5e7-4b6b-bc32-62d192d95415 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.079317 Mar 08 20:23:41.401096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1010/2055] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:41 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:42.417128 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:42.417847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:42.424087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:42.424572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:42.425349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:42.426399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:42.484426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:42.492083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cc9bf3c7-1914-4ec7-9481-c7c6bc0685f9 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078830 Mar 08 20:23:42.492667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1046/2056] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:42 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:43.509182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:43.510056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:43.516210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:43.516679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:43.517438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:43.517885 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:43.575685 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:43.583331 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0f455d2d-b25f-4172-aed9-021ed5e5fda8 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078008 Mar 08 20:23:43.583887 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1011/2057] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:43 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:44.600346 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:44.600937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:44.607460 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:44.607909 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:44.609027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:44.609464 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:44.671067 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:44.679433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e42a5757-bed8-4391-b4a6-6982a33273e0 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.083459 Mar 08 20:23:44.679974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1047/2058] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:44 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:45.696324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:45.696913 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:45.703238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:45.703703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:45.704494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:45.704938 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:45.763049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:45.770662 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5083ca8b-3bf0-4421-96e1-da25d7d833bc tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.078840 Mar 08 20:23:45.771235 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1012/2059] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:45 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:46.787448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:46.788059 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:46.794341 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:46.794793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:46.795564 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:46.796004 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:46.855534 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:46.863136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3dfa8b9f-550a-4890-8e68-d355b5da4976 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.080163 Mar 08 20:23:46.864299 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1048/2060] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:46 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:47.879968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:47.880620 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:47.887306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:47.887817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:47.888796 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:47.889369 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:47.957113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53cb58d77e454254a2ae77687df2c7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21199b1cdf9475b8db163893c789545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:47.965602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f84f34f6-df2b-4846-b220-57f087bac204 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 200 len: 1367 microversion: 2.1 time: 0.089420 Mar 08 20:23:47.966204 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1013/2061] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:47 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:48.351313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-907518069", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "networks": [{"uuid": "a2d533dc-0103-4e71-9899-9d2cb8e594ce"}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:23:48.406586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] validate_networks() for [('a2d533dc-0103-4e71-9899-9d2cb8e594ce', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 20:23:48.817786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 20:23:48.818210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 20:23:48.818683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 20:23:48.819085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 20:23:48.819495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 20:23:48.828091 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:48.828570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:48.829373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:48.829812 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:48.846438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Getting quotas for project 91c108d1c69e40f89916a988313e4cad. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:23:48.850316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Getting quotas for user b198e12afa0c448587955469475ad630 and project 91c108d1c69e40f89916a988313e4cad. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:23:48.860860 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 20:23:48.863084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 20:23:48.908827 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-66112203-4ac0-42a7-a3ca-534d2d91bf6b tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562021 Mar 08 20:23:48.909467 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1049/2062] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 20:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 20:23:48.919264 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2a3b76d3-e8b6-4656-8f0d-e18da6621136 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:48.919878 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2a3b76d3-e8b6-4656-8f0d-e18da6621136 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:48.970939 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-2a3b76d3-e8b6-4656-8f0d-e18da6621136 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:48.977407 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2a3b76d3-e8b6-4656-8f0d-e18da6621136 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1213 microversion: 2.1 time: 0.061908 Mar 08 20:23:48.978188 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1014/2063] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:48 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1213 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:48.983233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:48.983981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:48.990148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:48.990598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:48.991359 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:48.991793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:49.005753 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Instance fb579508-9118-47e4-a758-8e9c83890f77 could not be found. Mar 08 20:23:49.006349 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 404 to user: Instance fb579508-9118-47e4-a758-8e9c83890f77 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:49.007165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d4a543b4-a92e-44bc-97e2-f8ae75ac9564 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 404 len: 111 microversion: 2.1 time: 0.027816 Mar 08 20:23:49.007702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1050/2064] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:48 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 20:23:49.016121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c6e66ddb-c825-4384-bc57-d1281b5ca7ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '.version_select at 0x7f0704ff0e50>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:49.038060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c6e66ddb-c825-4384-bc57-d1281b5ca7ec tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549474882" status: 202 len: 0 microversion: 2.1 time: 0.025635 Mar 08 20:23:49.038626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1015/2065] 10.222.0.45 () {58 vars in 1217 bytes} [Tue Mar 8 20:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549474882 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:23:49.994948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:49.996399 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:50.010137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:50.010679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:50.011532 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:50.012582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:50.104684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:50.134888 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4876359f-a556-4d18-b617-2acfa8b37554 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1265 microversion: 2.1 time: 0.143743 Mar 08 20:23:50.135845 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1051/2066] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:49 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:51.152760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:51.153953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:51.161571 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:51.162253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:51.163410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:51.164014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:51.470692 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:51.489050 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cb38dd48-f82f-404e-a9da-4df82e500d47 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1313 microversion: 2.1 time: 0.339162 Mar 08 20:23:51.496991 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1016/2067] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:51 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:51.847592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-ab72292a-9ebf-4e4b-b1e5-80c1265029df req-bf7c9b23-5902-4f3c-93f3-b1661dffe576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd31ad07-b42b-480c-add3-8c367495ed4a", "tag": "c9cda59b-8b7f-4f21-822e-46228c0379c7"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:23:51.862334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ab72292a-9ebf-4e4b-b1e5-80c1265029df req-bf7c9b23-5902-4f3c-93f3-b1661dffe576 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:51.864938 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ab72292a-9ebf-4e4b-b1e5-80c1265029df req-bf7c9b23-5902-4f3c-93f3-b1661dffe576 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:51.877488 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-ab72292a-9ebf-4e4b-b1e5-80c1265029df req-bf7c9b23-5902-4f3c-93f3-b1661dffe576 service nova] Creating event network-changed:c9cda59b-8b7f-4f21-822e-46228c0379c7 for instance dd31ad07-b42b-480c-add3-8c367495ed4a on hv-cinder-83009 Mar 08 20:23:51.881786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: ERROR oslo.messaging._drivers.impl_rabbit [req-ab72292a-9ebf-4e4b-b1e5-80c1265029df req-bf7c9b23-5902-4f3c-93f3-b1661dffe576 service nova] [e3e99d77-5d7e-41e4-b769-29a9dc288eca] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 20:23:52.249203 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:52.250831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:52.261180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:52.261944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:52.263129 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:52.263767 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:52.281797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Instance fb579508-9118-47e4-a758-8e9c83890f77 could not be found. Mar 08 20:23:52.282405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 404 to user: Instance fb579508-9118-47e4-a758-8e9c83890f77 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:52.284191 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f0bf54c4-b1b9-42b5-bf84-f7e4efe6efd2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 404 len: 111 microversion: 2.1 time: 0.038539 Mar 08 20:23:52.286389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1017/2068] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:23:52 2022] DELETE /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 20:23:52.294125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:52.295014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: fb579508-9118-47e4-a758-8e9c83890f77] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:52.301671 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:52.302473 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:52.303439 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:52.304056 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:52.320644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Instance fb579508-9118-47e4-a758-8e9c83890f77 could not be found. Mar 08 20:23:52.321592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 404 to user: Instance fb579508-9118-47e4-a758-8e9c83890f77 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:52.322800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5741a469-462c-4ba6-b4c5-a61bb3bee1cf tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77" status: 404 len: 111 microversion: 2.1 time: 0.032636 Mar 08 20:23:52.327219 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1018/2069] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:52 2022] GET /compute/v2.1/servers/fb579508-9118-47e4-a758-8e9c83890f77 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:23:52.511378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:52.512266 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:52.518997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:52.520481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:52.521344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:52.522094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:52.698895 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:52.706244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7212dead-fb66-4175-9a41-3102c0b0a7a6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1313 microversion: 2.1 time: 0.201283 Mar 08 20:23:52.708322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1019/2070] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:52 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:52.890521 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [req-ab72292a-9ebf-4e4b-b1e5-80c1265029df req-bf7c9b23-5902-4f3c-93f3-b1661dffe576 service nova] [e3e99d77-5d7e-41e4-b769-29a9dc288eca] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 56570. Mar 08 20:23:52.897297 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-ab72292a-9ebf-4e4b-b1e5-80c1265029df req-bf7c9b23-5902-4f3c-93f3-b1661dffe576 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.052541 Mar 08 20:23:52.897904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1052/2071] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:23:53.500433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:53.501529 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:53.510756 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:53.511448 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:53.513551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:53.514359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:53.534063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Instance 477b451d-e030-4691-965c-19224d84c9b4 could not be found. Mar 08 20:23:53.534707 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 404 to user: Instance 477b451d-e030-4691-965c-19224d84c9b4 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:53.535586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a35778ec-114a-4218-9f78-c92e36853afa tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 404 len: 111 microversion: 2.1 time: 0.039351 Mar 08 20:23:53.536476 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1020/2072] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:23:53 2022] DELETE /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:23:53.545118 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:53.546316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] [instance: 477b451d-e030-4691-965c-19224d84c9b4] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:53.553193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:53.553925 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:53.554897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:53.555571 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:53.573570 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] HTTP exception thrown: Instance 477b451d-e030-4691-965c-19224d84c9b4 could not be found. Mar 08 20:23:53.574451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] Returning 404 to user: Instance 477b451d-e030-4691-965c-19224d84c9b4 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:23:53.575281 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5be220be-3b41-4e94-a1ac-683ae2eac8c2 tempest-AttachVolumeTestJSON-496164451 tempest-AttachVolumeTestJSON-496164451-project] 10.222.0.45 "GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4" status: 404 len: 111 microversion: 2.1 time: 0.034706 Mar 08 20:23:53.576005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1053/2073] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:53 2022] GET /compute/v2.1/servers/477b451d-e030-4691-965c-19224d84c9b4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:23:53.725129 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:53.726105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:53.736126 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:53.739027 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:53.739854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:53.740326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:54.027109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:54.039247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-32b9495c-784b-4da5-a93b-422ed4d213da tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1313 microversion: 2.1 time: 0.318119 Mar 08 20:23:54.043558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1021/2074] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:53 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:55.060120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:55.060742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:55.069229 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:55.069908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:55.071156 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:55.071850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:55.561582 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:55.578870 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e969916e-d0c3-41e0-9a93-caeb527cb160 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1313 microversion: 2.1 time: 0.524705 Mar 08 20:23:55.579620 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1054/2075] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:55 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:56.596380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:56.599660 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:56.618287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:56.619115 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:56.620137 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:56.620994 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:56.855149 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:56.869815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-52fb60e0-e63f-4bac-8732-e1d4363519d2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1313 microversion: 2.1 time: 0.277842 Mar 08 20:23:56.870943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1022/2076] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:56 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:57.887007 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:57.888332 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:57.894769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:57.895851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:57.896967 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:57.897646 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:58.214076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-ed17a66f-f21b-489e-a0ec-bdd3b8c4b231 req-f3b15758-a499-4939-9f60-1820917d0e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd31ad07-b42b-480c-add3-8c367495ed4a", "name": "network-vif-plugged", "status": "completed", "tag": "c9cda59b-8b7f-4f21-822e-46228c0379c7"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:23:58.224357 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ed17a66f-f21b-489e-a0ec-bdd3b8c4b231 req-f3b15758-a499-4939-9f60-1820917d0e76 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:58.225253 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ed17a66f-f21b-489e-a0ec-bdd3b8c4b231 req-f3b15758-a499-4939-9f60-1820917d0e76 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:58.237409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-ed17a66f-f21b-489e-a0ec-bdd3b8c4b231 req-f3b15758-a499-4939-9f60-1820917d0e76 service nova] Creating event network-vif-plugged:c9cda59b-8b7f-4f21-822e-46228c0379c7 for instance dd31ad07-b42b-480c-add3-8c367495ed4a on hv-cinder-83009 Mar 08 20:23:58.242093 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: ERROR oslo.messaging._drivers.impl_rabbit [req-ed17a66f-f21b-489e-a0ec-bdd3b8c4b231 req-f3b15758-a499-4939-9f60-1820917d0e76 service nova] [b4e3a161-3bde-4a64-8d22-036125e89b59] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 20:23:58.595094 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:58.605697 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b9d4954c-9f9a-4bb8-b495-ec534a679292 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1313 microversion: 2.1 time: 0.722623 Mar 08 20:23:58.617480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1055/2077] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:57 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:23:59.249656 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [req-ed17a66f-f21b-489e-a0ec-bdd3b8c4b231 req-f3b15758-a499-4939-9f60-1820917d0e76 service nova] [b4e3a161-3bde-4a64-8d22-036125e89b59] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 56696. Mar 08 20:23:59.254834 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-ed17a66f-f21b-489e-a0ec-bdd3b8c4b231 req-f3b15758-a499-4939-9f60-1820917d0e76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.310590 Mar 08 20:23:59.255441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1023/2078] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:23:59.629978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:23:59.630730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:23:59.638846 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:59.639358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:59.640152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:23:59.640626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:23:59.967668 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:23:59.977124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-886e83b8-6244-42aa-b852-b3b472380bbb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1313 microversion: 2.1 time: 0.357881 Mar 08 20:23:59.977861 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1056/2079] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:23:59 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:00.996390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:00.997449 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:01.006430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:01.009611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:01.011208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:01.012112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:01.630635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fb3b4ec3-001c-40f5-88ea-e4ba1ccd7bc5 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Action: 'create', calling method: .version_select at 0x7f0704907af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1589999589", "metadata": {"Type": "work"}}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:01.689591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:01.698715 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d934aba2-9a32-4dec-9e2b-1a448b73c63e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1498 microversion: 2.1 time: 0.707458 Mar 08 20:24:01.702621 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1024/2080] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:00 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1498 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:02.365057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:02.365684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:02.378195 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:02.379716 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:02.382810 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:02.383848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:02.387881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fb3b4ec3-001c-40f5-88ea-e4ba1ccd7bc5 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.174236 Mar 08 20:24:02.394977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1057/2081] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Mar 8 20:24:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1181 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 20:24:02.399718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a1637695-c7d4-4754-9ae7-d34612147e0d tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Calling method '.version_select at 0x7f070488d820>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:02.419274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:24:02.467970 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a1637695-c7d4-4754-9ae7-d34612147e0d tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792" status: 200 len: 353 microversion: 2.1 time: 0.071856 Mar 08 20:24:02.468813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1058/2082] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 20:24:02 2022] GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:02.511109 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-facde55a-0d2d-4785-bc12-ebd9d4ed1cb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 204 len: 0 microversion: 2.1 time: 0.149733 Mar 08 20:24:02.517121 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1025/2083] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:24:02 2022] DELETE /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 20:24:02.523270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:02.523882 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:02.530379 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:02.531260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:02.531588 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:02.532020 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:02.893915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:02.903940 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0db6da2a-cf3b-4a2b-b0a9-5b88644c1111 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1504 microversion: 2.1 time: 0.385748 Mar 08 20:24:02.914355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1059/2084] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:02 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:03.481040 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-88a96f48-ce37-4607-bcf2-c3d6eecbadf2 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Calling method '.version_select at 0x7f0704df0550>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:03.496663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:24:03.496840 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:24:03.585076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-88a96f48-ce37-4607-bcf2-c3d6eecbadf2 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792" status: 200 len: 354 microversion: 2.1 time: 0.107899 Mar 08 20:24:03.586284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1026/2085] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 20:24:03 2022] GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:03.597106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-39572e60-89ab-4160-a711-ccf702fec7aa tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Calling method '.version_select at 0x7f070498a8b0>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:03.706562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-39572e60-89ab-4160-a711-ccf702fec7aa tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792" status: 200 len: 354 microversion: 2.1 time: 0.113497 Mar 08 20:24:03.718443 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1060/2086] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 20:24:03 2022] GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:03.723765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0c752afa-5e0d-4915-8399-77b2ec7638a3 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Calling method '.version_select at 0x7f0704f4b8b0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:03.809153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0c752afa-5e0d-4915-8399-77b2ec7638a3 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792" status: 202 len: 0 microversion: 2.1 time: 0.089217 Mar 08 20:24:03.810320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1027/2087] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Mar 8 20:24:03 2022] DELETE /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:24:03.820197 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8e3b7246-4811-4e2f-a168-5986b47afed6 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Calling method '.version_select at 0x7f0704873e50>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:03.886689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8e3b7246-4811-4e2f-a168-5986b47afed6 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792" status: 200 len: 353 microversion: 2.1 time: 0.071536 Mar 08 20:24:03.888106 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1061/2088] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 20:24:03 2022] GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:03.924848 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:03.936497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:03.963409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:03.965285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:03.970977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:03.973610 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:04.435825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:04.445541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5b157f42-2ba3-407c-b4a1-be259f0c7894 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1504 microversion: 2.1 time: 0.527273 Mar 08 20:24:04.457765 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1028/2089] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:03 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:04.901395 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c2266d1-569e-427f-8c8d-6ee663905289 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Calling method '.version_select at 0x7f0709a49790>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:04.940614 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-4c2266d1-569e-427f-8c8d-6ee663905289 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] HTTP exception thrown: Volume fd310e48-e78e-4d11-996c-1a6846d76792 could not be found. Mar 08 20:24:04.941756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4c2266d1-569e-427f-8c8d-6ee663905289 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] Returning 404 to user: Volume fd310e48-e78e-4d11-996c-1a6846d76792 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:24:04.942739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4c2266d1-569e-427f-8c8d-6ee663905289 tempest-VolumesGetTestJSON-713282726 tempest-VolumesGetTestJSON-713282726-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792" status: 404 len: 109 microversion: 2.1 time: 0.046990 Mar 08 20:24:04.943562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1062/2090] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Mar 8 20:24:04 2022] GET /compute/v2.1/os-volumes/fd310e48-e78e-4d11-996c-1a6846d76792 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:24:05.480123 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:05.484207 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:05.522403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:05.525267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:05.530000 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:05.531813 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:05.758497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:05.772075 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7c84e104-01c1-4a5e-a4c4-de658f99db33 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 200 len: 1298 microversion: 2.1 time: 0.310840 Mar 08 20:24:05.784381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1029/2091] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:05 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 1298 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:05.897584 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-16b3a385-3549-4962-bad3-9d1d4c88f75d req-9f3b9217-7551-4c30-a4ec-ef341cc49370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd31ad07-b42b-480c-add3-8c367495ed4a", "name": "network-vif-deleted", "tag": "c9cda59b-8b7f-4f21-822e-46228c0379c7"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:05.932797 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-16b3a385-3549-4962-bad3-9d1d4c88f75d req-9f3b9217-7551-4c30-a4ec-ef341cc49370 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:05.937469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-16b3a385-3549-4962-bad3-9d1d4c88f75d req-9f3b9217-7551-4c30-a4ec-ef341cc49370 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:05.983675 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-16b3a385-3549-4962-bad3-9d1d4c88f75d req-9f3b9217-7551-4c30-a4ec-ef341cc49370 service nova] Creating event network-vif-deleted:c9cda59b-8b7f-4f21-822e-46228c0379c7 for instance dd31ad07-b42b-480c-add3-8c367495ed4a on hv-cinder-83009 Mar 08 20:24:06.004804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-16b3a385-3549-4962-bad3-9d1d4c88f75d req-9f3b9217-7551-4c30-a4ec-ef341cc49370 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.527658 Mar 08 20:24:06.007311 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1063/2092] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:06.799630 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:06.800800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: dd31ad07-b42b-480c-add3-8c367495ed4a] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:06.818353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:06.819067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:06.820076 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:06.820772 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:06.842904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] HTTP exception thrown: Instance dd31ad07-b42b-480c-add3-8c367495ed4a could not be found. Mar 08 20:24:06.843993 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Returning 404 to user: Instance dd31ad07-b42b-480c-add3-8c367495ed4a could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:24:06.845444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dab5fea8-7542-418f-90d5-7986040f6532 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a" status: 404 len: 111 microversion: 2.1 time: 0.054536 Mar 08 20:24:06.846859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1030/2093] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:06 2022] GET /compute/v2.1/servers/dd31ad07-b42b-480c-add3-8c367495ed4a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:24:07.001894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-692912393", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452", "networks": [{"uuid": "a2d533dc-0103-4e71-9899-9d2cb8e594ce"}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:07.062974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] validate_networks() for [('a2d533dc-0103-4e71-9899-9d2cb8e594ce', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 20:24:07.544549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 20:24:07.544975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 20:24:07.545718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 20:24:07.546130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 20:24:07.546542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 20:24:07.556454 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:07.557185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:07.558172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:07.559184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:07.596108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Getting quotas for project 91c108d1c69e40f89916a988313e4cad. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:24:07.609267 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Getting quotas for user b198e12afa0c448587955469475ad630 and project 91c108d1c69e40f89916a988313e4cad. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:24:07.620091 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6aa6317a-4a9f-4b03-b73b-fa676926d840 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Action: 'create', calling method: .version_select at 0x7f0704f053a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-420794653"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:07.624565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 20:24:07.627766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 20:24:07.640401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-6aa6317a-4a9f-4b03-b73b-fa676926d840 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:24:07.646719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-6aa6317a-4a9f-4b03-b73b-fa676926d840 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for user aab004ae4799496098bb0e57eff9659e and project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:24:07.688978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4239b798-39f3-45c5-b1cd-0ab11fcd72b2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693093 Mar 08 20:24:07.689623 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1064/2094] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 20:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 20:24:07.699723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-838e4ebd-32ef-48cf-8ccf-e04579eb94e8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:07.700218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-838e4ebd-32ef-48cf-8ccf-e04579eb94e8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:07.768436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-838e4ebd-32ef-48cf-8ccf-e04579eb94e8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:07.791786 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-838e4ebd-32ef-48cf-8ccf-e04579eb94e8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1213 microversion: 2.1 time: 0.096058 Mar 08 20:24:07.806058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1065/2095] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:07 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:24:08.039600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-6aa6317a-4a9f-4b03-b73b-fa676926d840 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:24:08.044454 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-6aa6317a-4a9f-4b03-b73b-fa676926d840 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for user aab004ae4799496098bb0e57eff9659e and project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:24:08.061113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6aa6317a-4a9f-4b03-b73b-fa676926d840 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.761007 Mar 08 20:24:08.067705 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1031/2096] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 20:24:07 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:08.815325 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:08.816129 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:08.827611 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:08.828276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:08.829419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:08.830429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:08.907812 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:08.917751 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-96d5e464-4a20-431d-9b6b-85fe3ed683bb tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1265 microversion: 2.1 time: 0.107761 Mar 08 20:24:08.918551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1066/2097] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:08 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:09.936646 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:09.937122 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:09.951427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:09.952617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:09.953414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:09.953998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:10.313703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:10.328389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9ab52064-f281-4dcb-bb08-4f093ada060e tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.394056 Mar 08 20:24:10.329014 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1032/2098] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:09 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:11.118707 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-96be5d90-ddc7-4a8a-a7ff-14d465eefaa3 req-4dd7b532-454d-4591-b269-7844ec4f0bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4571e07-0d5c-4d09-ba22-38cce6da6f2d", "tag": "569513de-a42d-461b-94f2-843fa89c3fb0"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:11.130174 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-96be5d90-ddc7-4a8a-a7ff-14d465eefaa3 req-4dd7b532-454d-4591-b269-7844ec4f0bff service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:11.130618 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-96be5d90-ddc7-4a8a-a7ff-14d465eefaa3 req-4dd7b532-454d-4591-b269-7844ec4f0bff service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:11.149058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-96be5d90-ddc7-4a8a-a7ff-14d465eefaa3 req-4dd7b532-454d-4591-b269-7844ec4f0bff service nova] Creating event network-changed:569513de-a42d-461b-94f2-843fa89c3fb0 for instance c4571e07-0d5c-4d09-ba22-38cce6da6f2d on hv-cinder-83009 Mar 08 20:24:11.154465 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-96be5d90-ddc7-4a8a-a7ff-14d465eefaa3 req-4dd7b532-454d-4591-b269-7844ec4f0bff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039457 Mar 08 20:24:11.155316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1067/2099] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:11.350158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:11.350649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:11.370265 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:11.370723 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:11.371525 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:11.371974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:11.712216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:11.722711 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3ea678ca-0aa0-41a3-afac-04ff065ea27d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.380167 Mar 08 20:24:11.724483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1033/2100] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:11 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:12.757040 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:12.758438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:12.766792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:12.767483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:12.768549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:12.769368 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:12.934720 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:12.942208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-cfd4ac66-d7a8-41f2-8311-c8d60ac800db tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.205310 Mar 08 20:24:12.942633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1068/2101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:12 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:13.961916 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:13.962380 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:13.968730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:13.969182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:13.969989 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:13.970435 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:14.140600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:14.148638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-edc3e21d-f2d5-4fbb-a114-4a12096c0be8 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.190837 Mar 08 20:24:14.149433 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1034/2102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:13 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:15.165975 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:15.166850 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:15.174997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:15.175572 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:15.176364 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:15.176815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:15.339568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:15.354305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-14cfba3a-7118-488b-9b76-1737b39a561c tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.192389 Mar 08 20:24:15.365507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1069/2103] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:15 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:24:16.370944 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:16.371570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:16.378348 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:16.378985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:16.379603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:16.380063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:16.518548 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:16.526582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-61f31a50-fe11-4704-b3d3-119eed7c45e7 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.159496 Mar 08 20:24:16.533101 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1035/2104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:16 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:17.526141 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-8243177e-3a67-4042-a28e-d7e4be64b828 req-a28db483-54f6-448f-85d9-895e1dc0c0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4571e07-0d5c-4d09-ba22-38cce6da6f2d", "name": "network-vif-plugged", "status": "completed", "tag": "569513de-a42d-461b-94f2-843fa89c3fb0"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:17.538921 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-8243177e-3a67-4042-a28e-d7e4be64b828 req-a28db483-54f6-448f-85d9-895e1dc0c0b9 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:17.539436 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-8243177e-3a67-4042-a28e-d7e4be64b828 req-a28db483-54f6-448f-85d9-895e1dc0c0b9 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:17.544022 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:17.544778 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:17.552146 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:17.553068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:17.554687 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:17.555333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:17.559008 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-8243177e-3a67-4042-a28e-d7e4be64b828 req-a28db483-54f6-448f-85d9-895e1dc0c0b9 service nova] Creating event network-vif-plugged:569513de-a42d-461b-94f2-843fa89c3fb0 for instance c4571e07-0d5c-4d09-ba22-38cce6da6f2d on hv-cinder-83009 Mar 08 20:24:17.565750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-8243177e-3a67-4042-a28e-d7e4be64b828 req-a28db483-54f6-448f-85d9-895e1dc0c0b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043111 Mar 08 20:24:17.566676 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1070/2105] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:17.712997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:17.720904 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5bbd1644-f572-47cf-a9b2-d156133d8eb6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.181448 Mar 08 20:24:17.721582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1036/2106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:17 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:18.742189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:18.742881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:18.751749 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:18.752195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:18.753066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:18.753422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:18.969728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:18.980847 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a080b50b-5be9-43e1-9ad8-e0c8cfb117c2 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1313 microversion: 2.1 time: 0.246193 Mar 08 20:24:18.981439 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1071/2107] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:18 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:19.997480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:19.998096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:20.004304 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:20.004909 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:20.005766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:20.006240 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:20.154127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:20.162615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b9ca6bcb-6e04-4e85-ba79-f947fb54536d tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1497 microversion: 2.1 time: 0.168979 Mar 08 20:24:20.163201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1037/2108] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:19 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:20.627280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:20.627869 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:20.634327 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:20.634990 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:20.635754 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:20.636193 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:20.663342 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:24:20.739484 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6a43a1fc-ee30-4063-bd79-47b88c65aad9 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 204 len: 0 microversion: 2.1 time: 0.115658 Mar 08 20:24:20.740136 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1072/2109] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:24:20 2022] DELETE /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:24:20.748958 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:20.749580 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:20.755638 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:20.756120 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:20.756950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:20.757386 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:20.912849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:20.924470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-30f2b0b8-4469-4af5-a23a-4efb7616e898 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1503 microversion: 2.1 time: 0.179633 Mar 08 20:24:20.925085 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1038/2110] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:20 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:21.943983 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:21.944701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:21.952024 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:21.952506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:21.953286 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:21.953718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:22.214704 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b198e12afa0c448587955469475ad630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c108d1c69e40f89916a988313e4cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:22.229122 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fdae3be1-ea5c-4804-9785-d24de80732c6 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 200 len: 1503 microversion: 2.1 time: 0.289670 Mar 08 20:24:22.230036 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1073/2111] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:21 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:22.779138 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-50bd448d-767f-4685-9231-25ddf07a8c2c req-c666beb9-b81f-4f96-8bce-1080ddf5396d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4571e07-0d5c-4d09-ba22-38cce6da6f2d", "name": "network-vif-deleted", "tag": "569513de-a42d-461b-94f2-843fa89c3fb0"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:22.790950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-50bd448d-767f-4685-9231-25ddf07a8c2c req-c666beb9-b81f-4f96-8bce-1080ddf5396d service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:22.791414 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-50bd448d-767f-4685-9231-25ddf07a8c2c req-c666beb9-b81f-4f96-8bce-1080ddf5396d service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:22.803370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-50bd448d-767f-4685-9231-25ddf07a8c2c req-c666beb9-b81f-4f96-8bce-1080ddf5396d service nova] Creating event network-vif-deleted:569513de-a42d-461b-94f2-843fa89c3fb0 for instance c4571e07-0d5c-4d09-ba22-38cce6da6f2d on hv-cinder-83009 Mar 08 20:24:22.808450 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-50bd448d-767f-4685-9231-25ddf07a8c2c req-c666beb9-b81f-4f96-8bce-1080ddf5396d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Mar 08 20:24:22.809047 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1039/2112] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:23.261969 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:23.265561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] [instance: c4571e07-0d5c-4d09-ba22-38cce6da6f2d] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:23.277719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:23.278411 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:23.279419 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:23.280029 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:23.296397 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] HTTP exception thrown: Instance c4571e07-0d5c-4d09-ba22-38cce6da6f2d could not be found. Mar 08 20:24:23.297531 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] Returning 404 to user: Instance c4571e07-0d5c-4d09-ba22-38cce6da6f2d could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:24:23.298492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-efc75141-208e-4948-a895-c06fc60d6692 tempest-VolumesActionsTest-964270212 tempest-VolumesActionsTest-964270212-project] 10.222.0.45 "GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d" status: 404 len: 111 microversion: 2.1 time: 0.055244 Mar 08 20:24:23.299165 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1074/2113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:23 2022] GET /compute/v2.1/servers/c4571e07-0d5c-4d09-ba22-38cce6da6f2d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:24:36.071577 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-695350110", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-420794653", "security_groups": [{"name": "tempest-secgroup-smoke-1521055579"}], "block_device_mapping_v2": [{"uuid": "748a5ae6-0600-43f4-bda8-f5eeff082809", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "546773f9-3d58-443e-852b-a01eb178b7d3"}]}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:36.216125 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] validate_networks() for [('546773f9-3d58-443e-852b-a01eb178b7d3', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 20:24:36.753534 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 20:24:36.754082 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 20:24:36.754619 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 20:24:36.755093 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 20:24:36.755572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 20:24:36.765532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:36.765976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:36.766768 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:36.767202 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:36.785696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:24:36.789570 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for user aab004ae4799496098bb0e57eff9659e and project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:24:36.853830 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 20:24:36.860766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='748a5ae6-0600-43f4-bda8-f5eeff082809',volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 20:24:37.017861 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-5f7aca20-d093-4bad-bdbb-2a47c857fa16 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.950432 Mar 08 20:24:37.018825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1040/2114] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 20:24:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 20:24:37.031189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-fc7bb9b5-cd50-4477-a535-bc8e9fb90451 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:37.036885 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-fc7bb9b5-cd50-4477-a535-bc8e9fb90451 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:37.108922 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-fc7bb9b5-cd50-4477-a535-bc8e9fb90451 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:37.116848 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-fc7bb9b5-cd50-4477-a535-bc8e9fb90451 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1093 microversion: 2.1 time: 0.091298 Mar 08 20:24:37.128269 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1075/2115] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:37 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1093 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:38.137398 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:38.139519 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:38.156927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:38.157551 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:38.160426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:38.161679 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:38.348776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:38.357866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-00616d15-00a8-479a-9f65-0539f5744362 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1199 microversion: 2.1 time: 0.226457 Mar 08 20:24:38.368690 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1041/2116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:38 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1199 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:39.374908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:39.375507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:39.391742 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:39.392187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:39.398790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:39.399490 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:39.683606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:39.700696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-baf6c7b1-94d3-4145-a06e-fe8899220904 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.329415 Mar 08 20:24:39.701728 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1076/2117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:39 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:40.426365 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-7bff5ac9-845b-43fa-b70e-f9d2ed7e6ffa req-a3b59c09-068e-44e7-8c37-99aba8993a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930faebe-410b-4fda-b8d5-b05301f540a9", "tag": "14d0f0f4-cdcd-42ab-a88a-531f54f71424"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:40.444103 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-7bff5ac9-845b-43fa-b70e-f9d2ed7e6ffa req-a3b59c09-068e-44e7-8c37-99aba8993a5a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:40.444874 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-7bff5ac9-845b-43fa-b70e-f9d2ed7e6ffa req-a3b59c09-068e-44e7-8c37-99aba8993a5a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:40.473078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-7bff5ac9-845b-43fa-b70e-f9d2ed7e6ffa req-a3b59c09-068e-44e7-8c37-99aba8993a5a service nova] Creating event network-changed:14d0f0f4-cdcd-42ab-a88a-531f54f71424 for instance 930faebe-410b-4fda-b8d5-b05301f540a9 on hv-cinder-83009 Mar 08 20:24:40.490002 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-7bff5ac9-845b-43fa-b70e-f9d2ed7e6ffa req-a3b59c09-068e-44e7-8c37-99aba8993a5a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067100 Mar 08 20:24:40.490873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1042/2118] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:24:40.721601 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:40.722096 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:40.730110 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:40.731305 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:40.731999 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:40.733700 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:41.331087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:41.345445 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a094f549-75f4-49a6-9ba4-c25b39ba2211 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.630158 Mar 08 20:24:41.346674 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1077/2119] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:40 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:42.364546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:42.367375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:42.381450 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:42.382748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:42.387222 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:42.387869 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:42.646915 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:42.655508 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-60a97ebb-180d-4901-b21b-6eb2d588cde6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.296069 Mar 08 20:24:42.657182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1043/2120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:42 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:43.673316 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:43.673927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:43.685781 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:43.686541 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:43.687626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:43.688226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:44.052274 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:44.070757 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-34a8121c-9b5d-427f-bc38-0180b2cf3579 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.396922 Mar 08 20:24:44.077367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1078/2121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:43 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:45.104423 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:45.104908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:45.117287 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:45.118153 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:45.118821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:45.119359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:45.425676 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:45.436049 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-051e0d5a-4f06-4080-9a4a-fa27791661b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.345515 Mar 08 20:24:45.448925 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1044/2122] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:45 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:24:46.458183 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:46.459244 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:46.466150 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:46.466729 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:46.471019 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:46.471810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:46.640577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:46.650894 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3ee37518-070a-4050-9ab9-3c8759706f85 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.198300 Mar 08 20:24:46.651809 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1079/2123] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:46 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:47.667033 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:47.668428 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:47.675931 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:47.685302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:47.686314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:47.686886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:48.057961 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:48.074990 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0822aef6-cee7-4ed4-9776-aa7983afb48c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.411588 Mar 08 20:24:48.075849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1045/2124] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:47 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:24:49.096159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:49.096597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:49.103282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:49.104204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:49.105231 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:49.106021 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:49.507471 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:49.515425 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8d301437-de67-4a83-9a30-174e273b422e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.427202 Mar 08 20:24:49.515989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1080/2125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:49 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:50.536440 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:50.539303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:50.567144 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:50.567597 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:50.568432 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:50.568870 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:51.266626 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:51.290637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-64826c99-a68e-4262-9d33-60eb084db85a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.755796 Mar 08 20:24:51.295923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1046/2126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:50 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:52.313031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:52.313641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:52.326557 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:52.327006 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:52.334994 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:52.335665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:52.766237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:52.779388 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0944d0c3-e407-4bd6-a87f-b30b3ada47b0 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.470442 Mar 08 20:24:52.780867 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1081/2127] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:52 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:53.127046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-2da430d7-0adc-4ea1-84c6-a14778d304f5 req-7cf4681d-df7f-4a0f-a1f2-708da6bffacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930faebe-410b-4fda-b8d5-b05301f540a9", "name": "network-vif-plugged", "status": "completed", "tag": "14d0f0f4-cdcd-42ab-a88a-531f54f71424"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:53.147058 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-2da430d7-0adc-4ea1-84c6-a14778d304f5 req-7cf4681d-df7f-4a0f-a1f2-708da6bffacd service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:53.147657 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-2da430d7-0adc-4ea1-84c6-a14778d304f5 req-7cf4681d-df7f-4a0f-a1f2-708da6bffacd service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:53.173632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-2da430d7-0adc-4ea1-84c6-a14778d304f5 req-7cf4681d-df7f-4a0f-a1f2-708da6bffacd service nova] Creating event network-vif-plugged:14d0f0f4-cdcd-42ab-a88a-531f54f71424 for instance 930faebe-410b-4fda-b8d5-b05301f540a9 on hv-cinder-83009 Mar 08 20:24:53.195046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-2da430d7-0adc-4ea1-84c6-a14778d304f5 req-7cf4681d-df7f-4a0f-a1f2-708da6bffacd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073253 Mar 08 20:24:53.196684 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1047/2128] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:24:53.740219 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1038136674", "imageRef": "cd367345-5f6e-466c-b935-4672744986f6", "flavorRef": "452"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:53.797087 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:53.810362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:53.827748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:53.828906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:53.833362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:53.837248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:53.841839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] validate_networks() for None {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 20:24:54.436492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 20:24:54.440865 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 20:24:54.441505 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 20:24:54.442050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 20:24:54.442552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 20:24:54.456384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:54.457016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:54.458280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:54.458822 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:54.481672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Getting quotas for project a22c2001598841fcb95a4cac7b9f9e62. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:24:54.486816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Getting quotas for user f7c1928a0c504671b3b8e0c18ffb5fbb and project a22c2001598841fcb95a4cac7b9f9e62. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:24:54.512095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:54.524374 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-0d14214c-511b-4df6-96e4-ef84ac0bb4e1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1265 microversion: 2.1 time: 0.731314 Mar 08 20:24:54.526850 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1048/2129] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:53 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1265 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:24:54.535673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 20:24:54.539153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd367345-5f6e-466c-b935-4672744986f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 20:24:54.635309 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f9bbbd58-35d2-40e1-8fd2-67273d940e7b tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899701 Mar 08 20:24:54.642997 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1082/2130] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 20:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 20:24:54.646600 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-483bce96-1fb4-41bf-85b1-82979202d881 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:54.650974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-483bce96-1fb4-41bf-85b1-82979202d881 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:54.725980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-483bce96-1fb4-41bf-85b1-82979202d881 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:54.740959 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-483bce96-1fb4-41bf-85b1-82979202d881 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1215 microversion: 2.1 time: 0.096501 Mar 08 20:24:54.744730 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1049/2131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:54 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:24:55.547924 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:55.550015 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:55.573044 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:55.574482 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:55.575657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:55.576458 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:55.763670 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:55.764515 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:55.783263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:55.784212 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:55.787285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:55.789533 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:55.920573 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:55.930028 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:55.935956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f8f87159-e291-41f7-adf6-166c7aa4e2e8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1452 microversion: 2.1 time: 0.394174 Mar 08 20:24:55.937978 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1083/2132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:55 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1452 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:55.942293 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-68754a47-ff68-44b8-ac82-75a698a981f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1267 microversion: 2.1 time: 0.180579 Mar 08 20:24:55.943199 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1050/2133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:55 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:55.968027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:55.968681 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:55.985600 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:55.986051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:55.988009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:55.988678 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:56.342213 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:56.352360 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5f469d0a-3693-4501-849a-34f4b04610e3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1452 microversion: 2.1 time: 0.389296 Mar 08 20:24:56.353955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1084/2134] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:55 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1452 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:56.959674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:56.962566 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:56.979241 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:56.979996 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:56.981292 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:56.982092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:57.150094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:57.158819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f7d48ba5-1bac-4546-bb04-9633a754244a tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1273 microversion: 2.1 time: 0.203453 Mar 08 20:24:57.167977 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1051/2135] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:56 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:58.185212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:24:58.187937 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:24:58.206759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:58.217092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:58.232181 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:58.240813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:59.344152 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:24:59.354622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-8162a716-0c39-4539-998f-322b5633949e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 1.173574 Mar 08 20:24:59.355523 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1085/2136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:24:58 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:24:59.409814 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-aaec0d6a-1c08-4ea5-ae2c-944b769eb89b req-2a18faf0-f546-4ee6-97ed-968fecd29074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65702c1-bedc-44ff-83fb-93fded146149", "tag": "a1896f6c-d2d7-4de2-9312-1c7d41daed54"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:24:59.429479 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-aaec0d6a-1c08-4ea5-ae2c-944b769eb89b req-2a18faf0-f546-4ee6-97ed-968fecd29074 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:24:59.430267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-aaec0d6a-1c08-4ea5-ae2c-944b769eb89b req-2a18faf0-f546-4ee6-97ed-968fecd29074 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:24:59.463556 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-aaec0d6a-1c08-4ea5-ae2c-944b769eb89b req-2a18faf0-f546-4ee6-97ed-968fecd29074 service nova] Creating event network-changed:a1896f6c-d2d7-4de2-9312-1c7d41daed54 for instance e65702c1-bedc-44ff-83fb-93fded146149 on hv-cinder-83009 Mar 08 20:24:59.475158 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-aaec0d6a-1c08-4ea5-ae2c-944b769eb89b req-2a18faf0-f546-4ee6-97ed-968fecd29074 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071368 Mar 08 20:24:59.476362 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1052/2137] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:00.377619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:00.378804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:00.390766 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:00.391501 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:00.393249 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:00.400740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:01.120077 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:01.131090 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4963ef73-2c31-4832-9f2f-18ff6e7c95f6 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.758083 Mar 08 20:25:01.134363 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1086/2138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:00 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:02.151607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:02.152912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:02.170765 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:02.171220 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:02.172042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:02.172515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:02.194547 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-e8cbad1f-99f2-4fd1-838d-ae3447374988 req-6a3bed36-e354-467b-a5e1-c8aeafcb25f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930faebe-410b-4fda-b8d5-b05301f540a9", "tag": "14d0f0f4-cdcd-42ab-a88a-531f54f71424"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:02.225446 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e8cbad1f-99f2-4fd1-838d-ae3447374988 req-6a3bed36-e354-467b-a5e1-c8aeafcb25f4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:02.231244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e8cbad1f-99f2-4fd1-838d-ae3447374988 req-6a3bed36-e354-467b-a5e1-c8aeafcb25f4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:02.257865 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-e8cbad1f-99f2-4fd1-838d-ae3447374988 req-6a3bed36-e354-467b-a5e1-c8aeafcb25f4 service nova] Creating event network-changed:14d0f0f4-cdcd-42ab-a88a-531f54f71424 for instance 930faebe-410b-4fda-b8d5-b05301f540a9 on hv-cinder-83009 Mar 08 20:25:02.270538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-e8cbad1f-99f2-4fd1-838d-ae3447374988 req-6a3bed36-e354-467b-a5e1-c8aeafcb25f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310795 Mar 08 20:25:02.271952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1053/2139] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:02.510813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:02.519943 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f8dfd3bb-6536-477f-9f78-07bb62b746c5 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.372125 Mar 08 20:25:02.520549 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1087/2140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:02 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:25:03.536852 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:03.537538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:03.546098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:03.546545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:03.547314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:03.547746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:03.726514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:03.734633 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d3aff60f-ffd1-4edf-9b73-15a4dcbaaf2f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.201750 Mar 08 20:25:03.738117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1054/2141] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:03 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:04.757264 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:04.762240 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:04.772011 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:04.772599 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:04.773468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:04.773912 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:04.934469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:04.942170 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ba457bc0-cdd3-4c23-9cd6-53dd33b06b25 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.192160 Mar 08 20:25:04.942946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1088/2142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:04 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:05.959615 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:05.963060 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:05.970182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:05.970706 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:05.971712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:05.972456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:06.114243 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:06.123218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f52bcd1e-3e09-46fe-82b1-32322d1c7a55 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.168068 Mar 08 20:25:06.125545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1055/2143] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:05 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:07.141653 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:07.142796 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:07.151251 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:07.151705 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:07.152518 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:07.152957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:07.336315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:07.345917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0a44087c-2c77-45c0-b886-00f9d015b671 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.207732 Mar 08 20:25:07.362185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1089/2144] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:07 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:08.371387 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:08.372695 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:08.381096 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:08.381880 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:08.382849 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:08.383846 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:08.541905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:08.551397 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a1e2f3c4-6fc6-4151-b0d4-b8a42a955570 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.185932 Mar 08 20:25:08.553061 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1056/2145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:08 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:08.574533 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-09cd0dfc-6082-423e-81f7-0895d24c9882 req-40e62509-0e88-4f9f-ac9c-1ae7fd7cffe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65702c1-bedc-44ff-83fb-93fded146149", "name": "network-vif-plugged", "status": "completed", "tag": "a1896f6c-d2d7-4de2-9312-1c7d41daed54"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:08.585001 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-09cd0dfc-6082-423e-81f7-0895d24c9882 req-40e62509-0e88-4f9f-ac9c-1ae7fd7cffe8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:08.586087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-09cd0dfc-6082-423e-81f7-0895d24c9882 req-40e62509-0e88-4f9f-ac9c-1ae7fd7cffe8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:08.588537 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-57e65b5a-ccaf-4536-b226-29d7cf84b84c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Action: 'create', calling method: .version_select at 0x7f0704ffc430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1423372726"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:08.607908 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-09cd0dfc-6082-423e-81f7-0895d24c9882 req-40e62509-0e88-4f9f-ac9c-1ae7fd7cffe8 service nova] Creating event network-vif-plugged:a1896f6c-d2d7-4de2-9312-1c7d41daed54 for instance e65702c1-bedc-44ff-83fb-93fded146149 on hv-cinder-83009 Mar 08 20:25:08.613280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-09cd0dfc-6082-423e-81f7-0895d24c9882 req-40e62509-0e88-4f9f-ac9c-1ae7fd7cffe8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043453 Mar 08 20:25:08.614179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1090/2146] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:08.616903 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-57e65b5a-ccaf-4536-b226-29d7cf84b84c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Getting quotas for project bdd15010b2584a6fba0ed753192e6572. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:25:08.621998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-57e65b5a-ccaf-4536-b226-29d7cf84b84c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Getting quotas for user 6a4a417b5c8748d28669e0a1375e8115 and project bdd15010b2584a6fba0ed753192e6572. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:25:09.044399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-57e65b5a-ccaf-4536-b226-29d7cf84b84c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Getting quotas for project bdd15010b2584a6fba0ed753192e6572. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:25:09.048905 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-57e65b5a-ccaf-4536-b226-29d7cf84b84c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Getting quotas for user 6a4a417b5c8748d28669e0a1375e8115 and project bdd15010b2584a6fba0ed753192e6572. Resources: {'key_pairs'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:25:09.062594 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-57e65b5a-ccaf-4536-b226-29d7cf84b84c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.479834 Mar 08 20:25:09.063187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1057/2147] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Mar 8 20:25:08 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:09.162282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1524478676", "imageRef": "c6e96053-a94d-46d7-a718-7eae6ad197c6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1423372726", "networks": [{"uuid": "9a504a45-1fdb-4612-a3ff-1dc3d9eb60da"}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:09.210838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] validate_networks() for [('9a504a45-1fdb-4612-a3ff-1dc3d9eb60da', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 20:25:09.570269 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:09.570883 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:09.576633 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:09.577092 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:09.577860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:09.578298 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:09.588475 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 20:25:09.588945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 20:25:09.589387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 20:25:09.589793 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 20:25:09.590201 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 20:25:09.601956 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:09.602402 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:09.603238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:09.603672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:09.629339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Getting quotas for project bdd15010b2584a6fba0ed753192e6572. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:25:09.633844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Getting quotas for user 6a4a417b5c8748d28669e0a1375e8115 and project bdd15010b2584a6fba0ed753192e6572. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:25:09.646453 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 20:25:09.648866 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6e96053-a94d-46d7-a718-7eae6ad197c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 20:25:09.700221 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9b4bdb91-0605-457e-8d8e-d77de3da4dc7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542218 Mar 08 20:25:09.701227 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1091/2148] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 20:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 20:25:09.711023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e1be26a3-c5f1-4d2c-be0e-f399b13adb8c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:09.711644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e1be26a3-c5f1-4d2c-be0e-f399b13adb8c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:09.724553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:09.733856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3ba17064-4477-4a6d-9b31-6ca593006355 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1315 microversion: 2.1 time: 0.167825 Mar 08 20:25:09.743413 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1058/2149] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:09 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:25:09.764101 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-e1be26a3-c5f1-4d2c-be0e-f399b13adb8c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:09.771507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e1be26a3-c5f1-4d2c-be0e-f399b13adb8c tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1259 microversion: 2.1 time: 0.064109 Mar 08 20:25:09.772073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1092/2150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:09 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:10.752340 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:10.753860 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:10.762552 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:10.763095 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:10.763951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:10.764506 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:10.789031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:10.790376 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:10.797635 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:10.798456 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:10.799366 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:10.800070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:10.869864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:10.877272 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-aa33a65e-3245-4ff8-81ce-27aa8974f68f tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1329 microversion: 2.1 time: 0.092033 Mar 08 20:25:10.877834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1093/2151] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:10 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1329 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:25:10.993769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:11.003201 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-f4b41705-f78f-41b5-8c41-28232ef32a02 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1465 microversion: 2.1 time: 0.255447 Mar 08 20:25:11.003708 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1059/2152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:10 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1465 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:11.043579 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:11.044084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:11.050841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:11.051510 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:11.052361 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:11.052801 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:11.081976 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:25:11.177948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-779647e1-782f-4279-8845-5d2f6f8da9a2 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 204 len: 0 microversion: 2.1 time: 0.137722 Mar 08 20:25:11.178542 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1094/2153] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:25:11 2022] DELETE /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:25:11.188024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:11.188664 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:11.195285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:11.195978 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:11.196797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:11.197238 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:11.438140 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:11.449225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-98b84dd3-7159-464e-9bbc-1bf8367fcfce tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.265961 Mar 08 20:25:11.454135 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1060/2154] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:11 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:25:11.898839 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:11.899638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:11.913223 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:11.913673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:11.914463 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:11.914899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:12.083028 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:12.091149 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ddf13969-516d-4ec7-8d88-5f9169b759a9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.198596 Mar 08 20:25:12.091798 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1095/2155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:11 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:12.467062 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:12.467700 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:12.475415 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:12.476031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:12.476987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:12.477580 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:12.638200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:12.653611 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d55e3229-4491-4019-acfd-5e158cfa9f85 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.190398 Mar 08 20:25:12.658248 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1061/2156] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:12 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:13.109545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:13.111220 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:13.120790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:13.121413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:13.122293 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:13.122800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:13.269124 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:13.277344 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a6fd8520-cb1f-4c9b-880a-052c9a44cf62 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.171681 Mar 08 20:25:13.284497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1096/2157] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:13 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:13.670593 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:13.671366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:13.678009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:13.678578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:13.679465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:13.680011 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:13.821139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:13.829981 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-56b5f103-7a8c-4d04-adba-d6132d457365 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.162659 Mar 08 20:25:13.841244 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1062/2158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:13 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:14.295357 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:14.296665 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:14.303987 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:14.304511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:14.305750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:14.306185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:14.450559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:14.461530 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-78f7d9ea-e157-4980-88a8-8de351054e71 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.170151 Mar 08 20:25:14.462402 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1097/2159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:14 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:14.848214 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:14.848881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:14.856553 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:14.857007 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:14.857831 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:14.858284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:15.006665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:15.014563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-71749043-8a5b-425f-b8c2-a55cb6e0d44e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.170209 Mar 08 20:25:15.015318 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1063/2160] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:14 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:15.478633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:15.480081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:15.487486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:15.488016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:15.488903 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:15.489413 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:15.644586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:15.651953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-95619798-4bdd-468c-bee5-d198d28afb65 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.177309 Mar 08 20:25:15.652673 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1098/2161] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:15 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:16.033550 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:16.034159 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:16.040301 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:16.040857 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:16.041712 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:16.042333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:16.187315 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:16.194987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-92b68cef-5081-436c-a5ac-552a335c0a4f tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.166398 Mar 08 20:25:16.195563 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1064/2162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:16 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:25:16.669576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:16.670280 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:16.676769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:16.677226 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:16.678009 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:16.678447 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:16.821483 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:16.834496 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-91ff9ab5-4181-4a8e-8101-6abe582ca73b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.168936 Mar 08 20:25:16.835218 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1099/2163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:16 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:17.212749 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:17.213427 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:17.224985 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:17.225437 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:17.226216 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:17.226653 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:17.374034 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:17.381702 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-dbaa5a78-5dce-4559-900c-d4fcee0cb57e tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.172973 Mar 08 20:25:17.382284 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1065/2164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:17 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:17.864270 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:17.864947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:17.874701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:17.875155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:17.875935 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:17.876433 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:18.020818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:18.028072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-9e2d2ab6-f853-4a5b-be75-da82e46cf55b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.180647 Mar 08 20:25:18.028671 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1100/2165] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:17 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:18.399136 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:18.399755 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:18.406366 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:18.406834 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:18.407673 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:18.408112 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:18.570053 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:18.577833 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-78b02b0f-8903-4ede-8c6d-2072d8587a12 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.182590 Mar 08 20:25:18.578404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1066/2166] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:18 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:19.044591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:19.045232 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:19.052172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:19.052657 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:19.053432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:19.053864 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:19.195144 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:19.204626 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-7a9c125f-f176-4cc1-b1a4-593f3accc8d8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.163625 Mar 08 20:25:19.205825 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1101/2167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:19 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:19.594800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:19.595410 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:19.601717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:19.602173 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:19.602943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:19.603385 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:19.734535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:19.741866 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7c15f177-85e9-4212-b8ce-79cb9d6678a0 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.150850 Mar 08 20:25:19.742346 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1067/2168] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:19 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:20.221684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:20.222302 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:20.228627 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:20.229081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:20.229852 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:20.230287 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:20.359414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:20.367189 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5b832bcd-27c0-423d-a095-3ca2debed9eb tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.149418 Mar 08 20:25:20.367702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1102/2169] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:20 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:20.758647 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:20.759289 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:20.765613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:20.766063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:20.767400 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:20.767835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:20.898908 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:20.906363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-df70d837-8dcf-43cf-ab2a-ae72a07d3c19 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.151783 Mar 08 20:25:20.906924 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1068/2170] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:20 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:21.383455 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:21.384081 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:21.390382 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:21.390834 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:21.392102 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:21.392566 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:21.523076 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:21.530438 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3db25735-f8f1-4d5b-90d9-a0932bf54971 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.151115 Mar 08 20:25:21.531000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1103/2171] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:21 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:21.813280 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-9dc7ba28-91ad-418c-9262-fc6215867f94 req-376a971c-93f7-4e69-9e70-9245f4ca42c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be66b7-2323-4cc6-9ceb-226bdb18e831", "tag": "f09758ad-83cc-4a46-b51e-4a04bb3af591"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:21.825145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-9dc7ba28-91ad-418c-9262-fc6215867f94 req-376a971c-93f7-4e69-9e70-9245f4ca42c8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:21.825598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-9dc7ba28-91ad-418c-9262-fc6215867f94 req-376a971c-93f7-4e69-9e70-9245f4ca42c8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:21.836966 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-9dc7ba28-91ad-418c-9262-fc6215867f94 req-376a971c-93f7-4e69-9e70-9245f4ca42c8 service nova] Creating event network-changed:f09758ad-83cc-4a46-b51e-4a04bb3af591 for instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 on hv-cinder-83009 Mar 08 20:25:21.847344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-9dc7ba28-91ad-418c-9262-fc6215867f94 req-376a971c-93f7-4e69-9e70-9245f4ca42c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038009 Mar 08 20:25:21.847951 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1069/2172] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:21.922945 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:21.923915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:21.933634 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:21.934371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:21.935145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:21.935787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:22.071567 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:22.079540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-a7739341-8f76-449b-b378-bb4ce1cd3bb1 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.159933 Mar 08 20:25:22.080203 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1104/2173] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:21 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:22.547459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:22.548758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:22.554829 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:22.555277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:22.556041 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:22.556507 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:22.750303 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:22.757546 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7014831c-21dc-492a-95bc-ad1fdaf20726 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.214311 Mar 08 20:25:22.758370 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1070/2174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:22 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:23.096683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:23.097632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:23.104053 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:23.104540 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:23.105321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:23.105764 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:23.296319 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1928a0c504671b3b8e0c18ffb5fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22c2001598841fcb95a4cac7b9f9e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:23.304010 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-49d8b67c-133a-4fc6-8d51-a66611b30293 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 200 len: 1471 microversion: 2.1 time: 0.211182 Mar 08 20:25:23.304778 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1105/2175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:23 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:23.398505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-083b634e-0c53-4662-a7c7-e7e8f5447bcb req-ea90e4ec-11f1-432e-b209-4094c5858cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65702c1-bedc-44ff-83fb-93fded146149", "name": "network-vif-deleted", "tag": "a1896f6c-d2d7-4de2-9312-1c7d41daed54"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:23.407773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-083b634e-0c53-4662-a7c7-e7e8f5447bcb req-ea90e4ec-11f1-432e-b209-4094c5858cc8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:23.408210 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-083b634e-0c53-4662-a7c7-e7e8f5447bcb req-ea90e4ec-11f1-432e-b209-4094c5858cc8 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:23.426568 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-083b634e-0c53-4662-a7c7-e7e8f5447bcb req-ea90e4ec-11f1-432e-b209-4094c5858cc8 service nova] Creating event network-vif-deleted:a1896f6c-d2d7-4de2-9312-1c7d41daed54 for instance e65702c1-bedc-44ff-83fb-93fded146149 on hv-cinder-83009 Mar 08 20:25:23.431723 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-083b634e-0c53-4662-a7c7-e7e8f5447bcb req-ea90e4ec-11f1-432e-b209-4094c5858cc8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037470 Mar 08 20:25:23.432469 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1071/2176] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:23.774902 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:23.775513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:23.781448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:23.781899 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:23.783163 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:23.783597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:23.918254 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:23.925600 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4d2a39bd-2fa2-44c8-ae6d-dc267971b9a0 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.154363 Mar 08 20:25:23.926026 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1106/2177] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:23 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:24.322342 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:24.323424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] [instance: e65702c1-bedc-44ff-83fb-93fded146149] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:24.329790 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:24.330327 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:24.331098 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:24.331520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:24.344510 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] HTTP exception thrown: Instance e65702c1-bedc-44ff-83fb-93fded146149 could not be found. Mar 08 20:25:24.345094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] Returning 404 to user: Instance e65702c1-bedc-44ff-83fb-93fded146149 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:25:24.345906 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-614e4427-6cd6-4165-9249-57a41d8b02c7 tempest-VolumesNegativeTest-1313498282 tempest-VolumesNegativeTest-1313498282-project] 10.222.0.45 "GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149" status: 404 len: 111 microversion: 2.1 time: 0.027799 Mar 08 20:25:24.346445 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1072/2178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:24 2022] GET /compute/v2.1/servers/e65702c1-bedc-44ff-83fb-93fded146149 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:25:24.943247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:24.945098 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:24.959689 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:24.960179 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:24.961041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:24.961661 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:25.134481 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:25.143819 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-415aeb69-7793-4c7b-b206-ae9387b0199a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.205222 Mar 08 20:25:25.144473 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1107/2179] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:24 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:26.160696 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:26.161313 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:26.167389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:26.167719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:26.168514 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:26.168983 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:26.318261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:26.325703 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-90422b7e-2382-461d-b02e-667e03cd2602 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.169322 Mar 08 20:25:26.326614 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1073/2180] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:26 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:26.745073 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-cb09d230-4e3f-4c36-ab35-dcbccd0b7ba5 req-1ace04db-f570-4c20-8818-4332a6aa162c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6be66b7-2323-4cc6-9ceb-226bdb18e831", "name": "network-vif-plugged", "status": "completed", "tag": "f09758ad-83cc-4a46-b51e-4a04bb3af591"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:26.754543 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-cb09d230-4e3f-4c36-ab35-dcbccd0b7ba5 req-1ace04db-f570-4c20-8818-4332a6aa162c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:26.754979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-cb09d230-4e3f-4c36-ab35-dcbccd0b7ba5 req-1ace04db-f570-4c20-8818-4332a6aa162c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:26.771553 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-cb09d230-4e3f-4c36-ab35-dcbccd0b7ba5 req-1ace04db-f570-4c20-8818-4332a6aa162c service nova] Creating event network-vif-plugged:f09758ad-83cc-4a46-b51e-4a04bb3af591 for instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 on hv-cinder-83009 Mar 08 20:25:26.777022 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-cb09d230-4e3f-4c36-ab35-dcbccd0b7ba5 req-1ace04db-f570-4c20-8818-4332a6aa162c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040354 Mar 08 20:25:26.782818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1108/2181] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:27.342165 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:27.342781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:27.349651 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:27.350094 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:27.350863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:27.351302 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:27.482152 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:27.489409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c4028afb-52e4-4ba2-b860-58d246cd8c77 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.151040 Mar 08 20:25:27.489998 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1074/2182] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:27 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:28.507380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:28.508817 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:28.515632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:28.516168 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:28.517048 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:28.517492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:28.651326 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:28.659031 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-848edb10-efa5-475c-a0fd-3f3a6d24636d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.156791 Mar 08 20:25:28.659585 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1109/2183] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:28 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:29.675881 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:29.676566 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:29.682758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:29.683200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:29.683957 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:29.684425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:29.820344 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:29.828275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a783a636-ac1b-45eb-8e5b-72ff04f4e723 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1359 microversion: 2.1 time: 0.156832 Mar 08 20:25:29.829405 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1075/2184] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:29 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:30.845663 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:30.846275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:30.853159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:30.853612 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:30.854440 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:30.854877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:30.990500 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:30.997808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0820bcf5-c6ea-4aa9-8808-633ce8f7f251 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1549 microversion: 2.1 time: 0.157036 Mar 08 20:25:30.998371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1110/2185] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:30 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:31.015758 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:31.016952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:31.023455 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:31.023923 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:31.024721 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:31.025155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:31.166288 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:31.174078 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ec2a895b-c04e-4e67-96cf-bab40bdd9cc9 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1549 microversion: 2.1 time: 0.162230 Mar 08 20:25:31.174643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1076/2186] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:31 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:31.189974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:31.193450 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:31.194210 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Searching by: {'deleted': False, 'project_id': 'bdd15010b2584a6fba0ed753192e6572'} {{(pid=123380) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 08 20:25:31.200738 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:31.201188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:31.201988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:31.202424 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:31.297063 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.multi_cell_list [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123380) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 08 20:25:31.394495 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-0bf689d6-e062-4e3b-82b1-abba63509766 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208880 Mar 08 20:25:31.395000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1111/2187] 10.222.0.45 () {58 vars in 1124 bytes} [Tue Mar 8 20:25:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:25:31.404891 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:31.405505 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:31.411364 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:31.411786 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:31.412561 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:31.412987 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:31.544509 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:31.551694 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8b07907e-ab9e-4bef-80a2-a67f49bbe6c4 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1549 microversion: 2.1 time: 0.150615 Mar 08 20:25:31.552247 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1077/2188] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:31 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:33.049928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ab97d7d5-abce-4def-96e3-915285170906 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e267357-2396-4276-96e0-c12f796548fa"}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:33.050982 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ab97d7d5-abce-4def-96e3-915285170906 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:33.057207 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab97d7d5-abce-4def-96e3-915285170906 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:33.057655 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab97d7d5-abce-4def-96e3-915285170906 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:33.058416 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab97d7d5-abce-4def-96e3-915285170906 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:33.058849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ab97d7d5-abce-4def-96e3-915285170906 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:35.375981 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ab97d7d5-abce-4def-96e3-915285170906 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.330323 Mar 08 20:25:35.376816 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1112/2189] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Mar 8 20:25:33 2022] POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments => generated 194 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:42.908200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:42.909046 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:42.915275 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:42.915726 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:42.916532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:42.916968 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:43.055209 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:43.062911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-8ca80d7c-870e-4d0c-9c3e-33dbbdcb0f23 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1595 microversion: 2.1 time: 0.159144 Mar 08 20:25:43.063470 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1078/2190] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:42 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:25:44.860857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-b2d5d56d-4611-41bb-8bf0-c28fd0133721 req-f82cdafa-25b3-4df9-bd15-1d672936fe66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be66b7-2323-4cc6-9ceb-226bdb18e831", "tag": "f09758ad-83cc-4a46-b51e-4a04bb3af591"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:44.869476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-b2d5d56d-4611-41bb-8bf0-c28fd0133721 req-f82cdafa-25b3-4df9-bd15-1d672936fe66 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:44.869926 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-b2d5d56d-4611-41bb-8bf0-c28fd0133721 req-f82cdafa-25b3-4df9-bd15-1d672936fe66 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:44.881093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-b2d5d56d-4611-41bb-8bf0-c28fd0133721 req-f82cdafa-25b3-4df9-bd15-1d672936fe66 service nova] Creating event network-changed:f09758ad-83cc-4a46-b51e-4a04bb3af591 for instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 on hv-cinder-83009 Mar 08 20:25:44.886511 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-b2d5d56d-4611-41bb-8bf0-c28fd0133721 req-f82cdafa-25b3-4df9-bd15-1d672936fe66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030147 Mar 08 20:25:44.887346 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1113/2191] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:25:46.193512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-245749661"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:46.194117 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:46.200372 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:46.200820 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:46.201582 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:46.202013 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:46.331187 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.network.security_group_api [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Adding security group 4e9d310e-3611-40a0-ae0d-53f9ae436360 to port f09758ad-83cc-4a46-b51e-4a04bb3af591 Mar 08 20:25:46.678274 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e036061a-aede-4efd-9a8d-bac42dc23d4a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/action" status: 202 len: 0 microversion: 2.1 time: 0.488865 Mar 08 20:25:46.679127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1079/2192] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 20:25:46 2022] POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:25:46.689358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:25:46.690255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:25:46.700169 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:46.700639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:46.701412 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:46.701842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:46.901441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-42a2abec-1b67-4345-b592-9f1ab576a286 req-98332da3-2506-4b0a-b3ff-90358848b4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be66b7-2323-4cc6-9ceb-226bdb18e831", "tag": "f09758ad-83cc-4a46-b51e-4a04bb3af591"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:25:46.919406 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-42a2abec-1b67-4345-b592-9f1ab576a286 req-98332da3-2506-4b0a-b3ff-90358848b4cd service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:25:46.919859 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-42a2abec-1b67-4345-b592-9f1ab576a286 req-98332da3-2506-4b0a-b3ff-90358848b4cd service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:25:46.934681 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-42a2abec-1b67-4345-b592-9f1ab576a286 req-98332da3-2506-4b0a-b3ff-90358848b4cd service nova] Creating event network-changed:f09758ad-83cc-4a46-b51e-4a04bb3af591 for instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 on hv-cinder-83009 Mar 08 20:25:46.942263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-42a2abec-1b67-4345-b592-9f1ab576a286 req-98332da3-2506-4b0a-b3ff-90358848b4cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044389 Mar 08 20:25:46.943200 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1080/2193] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:25:46.992886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:25:47.003506 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-19c94d23-75e5-4ddc-88b0-d9d81c22691b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1760 microversion: 2.1 time: 0.319511 Mar 08 20:25:47.004794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1114/2194] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:25:46 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1760 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:19.087965 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-d0435c92-af2a-48a4-bd0f-089e833ec831 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:26:19.089036 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-d0435c92-af2a-48a4-bd0f-089e833ec831 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:19.095111 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0435c92-af2a-48a4-bd0f-089e833ec831 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:19.095565 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0435c92-af2a-48a4-bd0f-089e833ec831 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:19.096353 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0435c92-af2a-48a4-bd0f-089e833ec831 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:19.096800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-d0435c92-af2a-48a4-bd0f-089e833ec831 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:19.166029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-d0435c92-af2a-48a4-bd0f-089e833ec831 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/action" status: 202 len: 0 microversion: 2.1 time: 0.082253 Mar 08 20:26:19.166645 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1081/2195] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 20:26:19 2022] POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:26:19.175042 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:19.175641 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:19.181930 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:19.182390 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:19.183159 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:19.183617 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:19.332355 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:19.340718 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5578a45e-a327-430a-9ade-a94507409056 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1752 microversion: 2.1 time: 0.169794 Mar 08 20:26:19.341216 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1115/2196] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:19 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:20.359844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:20.360558 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:20.366572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:20.367016 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:20.367766 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:20.368194 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:20.510064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:20.517710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-47981543-b28c-4cdd-9950-3e82fb61d30b tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.163230 Mar 08 20:26:20.518263 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1082/2197] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:20 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:21.535551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:21.536066 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:21.542345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:21.542790 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:21.543547 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:21.543979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:21.688669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:21.696432 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-357fd15e-690e-45d7-92c9-799c1c8727c3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.164787 Mar 08 20:26:21.696991 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1116/2198] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:21 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:22.713180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:22.713779 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:22.721102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:22.721550 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:22.722314 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:22.722754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:22.865598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:22.873192 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b2aca72b-1fc0-431f-b488-07b8abb3ec13 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.163885 Mar 08 20:26:22.873751 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1083/2199] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:22 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:23.890841 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:23.891449 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:23.897709 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:23.898155 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:23.898915 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:23.899347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:24.048137 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:24.055874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-20d3ac15-5cde-4860-9505-987671345144 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.169447 Mar 08 20:26:24.056537 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1117/2200] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:23 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:25.072776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:25.073383 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:25.080224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:25.080769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:25.081539 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:25.081976 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:25.223815 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:25.231856 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ba40ea60-0779-43b7-a880-b4816f7bda8d tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.162923 Mar 08 20:26:25.232461 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1084/2201] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:25 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:26.249107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:26.249780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:26.255652 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:26.256120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:26.257164 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:26.257597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:26.399649 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:26.407303 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-542a60b1-2afc-4d46-87b1-89265537c2f3 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.162157 Mar 08 20:26:26.407891 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1118/2202] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:26 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:27.425649 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:27.426182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:27.432126 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:27.432613 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:27.433381 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:27.433819 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:27.582097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:27.589863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-00450132-2d6d-453b-8da0-0e15e396e95e tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.168177 Mar 08 20:26:27.590424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1085/2203] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:27 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:28.605837 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:28.606435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:28.613238 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:28.613684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:28.614435 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:28.614863 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:28.757607 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:28.765371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-32fae3cd-07d8-4ded-96d5-1591f9898a7a tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.163366 Mar 08 20:26:28.765877 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1119/2204] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:28 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:29.782863 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:29.783545 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:29.790070 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:29.790592 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:29.791441 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:29.791949 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:29.947481 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:29.955888 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-ec5a0e1a-3fae-40d7-8603-30d481203a78 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1757 microversion: 2.1 time: 0.177705 Mar 08 20:26:29.956538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1086/2205] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:29 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:26:30.973480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:26:30.974084 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:26:30.980347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:30.980800 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:30.981565 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:26:30.982000 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:26:31.130330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:26:31.138230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b59ebd9d-6091-440b-93cb-c4a8bdfbd7b7 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1760 microversion: 2.1 time: 0.168587 Mar 08 20:26:31.138780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1120/2206] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:26:30 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:03.514591 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-245749661"}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:03.515118 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:03.521118 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:03.521569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:03.522335 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:03.522776 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:03.658698 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.network.security_group_api [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Removing security group 4e9d310e-3611-40a0-ae0d-53f9ae436360 from port f09758ad-83cc-4a46-b51e-4a04bb3af591 Mar 08 20:27:03.985602 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-34f17d06-601f-4979-ba87-f9e07048d441 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/action" status: 202 len: 0 microversion: 2.1 time: 0.475663 Mar 08 20:27:03.988162 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1087/2207] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Mar 8 20:27:03 2022] POST /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:27:03.996381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-ce27b513-1d59-49cd-bbf9-f908320afa78 req-5ca62ded-27b8-4ebb-86cf-6805b4427404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be66b7-2323-4cc6-9ceb-226bdb18e831", "tag": "f09758ad-83cc-4a46-b51e-4a04bb3af591"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:04.004979 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ce27b513-1d59-49cd-bbf9-f908320afa78 req-5ca62ded-27b8-4ebb-86cf-6805b4427404 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:04.005429 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-ce27b513-1d59-49cd-bbf9-f908320afa78 req-5ca62ded-27b8-4ebb-86cf-6805b4427404 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:04.017178 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-ce27b513-1d59-49cd-bbf9-f908320afa78 req-5ca62ded-27b8-4ebb-86cf-6805b4427404 service nova] Creating event network-changed:f09758ad-83cc-4a46-b51e-4a04bb3af591 for instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 on hv-cinder-83009 Mar 08 20:27:04.029115 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-ce27b513-1d59-49cd-bbf9-f908320afa78 req-5ca62ded-27b8-4ebb-86cf-6805b4427404 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036478 Mar 08 20:27:04.030097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1121/2208] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:27:05.321836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:05.322326 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:05.328494 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:05.328952 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:05.329734 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:05.330169 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:05.413145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.objects.instance [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lazy-loading 'services' on Instance uuid e6be66b7-2323-4cc6-9ceb-226bdb18e831 {{(pid=123381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:27:05.485661 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2a65e7cb-0b6b-4b2d-a9a9-b7f05d11d0a8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments/5e267357-2396-4276-96e0-c12f796548fa" status: 202 len: 0 microversion: 2.1 time: 0.167952 Mar 08 20:27:05.486567 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1088/2209] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 20:27:05 2022] DELETE /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments/5e267357-2396-4276-96e0-c12f796548fa => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:27:05.496338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-1bcd0784-b090-4c6d-bf0d-284b5670f842 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:05.497966 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-1bcd0784-b090-4c6d-bf0d-284b5670f842 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:05.504679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bcd0784-b090-4c6d-bf0d-284b5670f842 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:05.505139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bcd0784-b090-4c6d-bf0d-284b5670f842 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:05.505941 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bcd0784-b090-4c6d-bf0d-284b5670f842 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:05.506759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-1bcd0784-b090-4c6d-bf0d-284b5670f842 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:05.537948 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-1bcd0784-b090-4c6d-bf0d-284b5670f842 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Mar 08 20:27:05.538507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1122/2210] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:27:05 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:27:06.045285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-8bcd5952-6d4b-4aea-9b8c-3dc3a3ea0a92 req-a0e8fbc9-0283-485b-8494-edd9a2229076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be66b7-2323-4cc6-9ceb-226bdb18e831", "tag": "f09758ad-83cc-4a46-b51e-4a04bb3af591"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:06.053435 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-8bcd5952-6d4b-4aea-9b8c-3dc3a3ea0a92 req-a0e8fbc9-0283-485b-8494-edd9a2229076 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:06.053873 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-8bcd5952-6d4b-4aea-9b8c-3dc3a3ea0a92 req-a0e8fbc9-0283-485b-8494-edd9a2229076 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:06.064871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-8bcd5952-6d4b-4aea-9b8c-3dc3a3ea0a92 req-a0e8fbc9-0283-485b-8494-edd9a2229076 service nova] Creating event network-changed:f09758ad-83cc-4a46-b51e-4a04bb3af591 for instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 on hv-cinder-83009 Mar 08 20:27:06.069746 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-8bcd5952-6d4b-4aea-9b8c-3dc3a3ea0a92 req-a0e8fbc9-0283-485b-8494-edd9a2229076 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029136 Mar 08 20:27:06.070518 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1089/2211] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:27:06.549590 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-df53d5c2-6f0f-420a-b4b0-862db10ca041 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:06.550422 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-df53d5c2-6f0f-420a-b4b0-862db10ca041 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:06.556794 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df53d5c2-6f0f-420a-b4b0-862db10ca041 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:06.557248 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df53d5c2-6f0f-420a-b4b0-862db10ca041 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:06.558058 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df53d5c2-6f0f-420a-b4b0-862db10ca041 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:06.558491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-df53d5c2-6f0f-420a-b4b0-862db10ca041 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:06.585954 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-df53d5c2-6f0f-420a-b4b0-862db10ca041 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040284 Mar 08 20:27:06.586606 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1123/2212] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Mar 8 20:27:06 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 20:27:06.597351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:06.597929 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:06.604324 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:06.604762 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:06.605520 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:06.605950 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:06.676867 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] HTTP exception thrown: Instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 is not attached to volume 5e267357-2396-4276-96e0-c12f796548fa Mar 08 20:27:06.677456 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Returning 404 to user: Instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 is not attached to volume 5e267357-2396-4276-96e0-c12f796548fa {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:27:06.678276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7c9e3a99-927d-49e2-8893-f1b828efec08 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments/5e267357-2396-4276-96e0-c12f796548fa" status: 404 len: 154 microversion: 2.1 time: 0.085281 Mar 08 20:27:06.678808 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1090/2213] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Mar 8 20:27:06 2022] DELETE /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831/os-volume_attachments/5e267357-2396-4276-96e0-c12f796548fa => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:27:07.805878 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:07.806374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:07.813113 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:07.813561 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:07.814315 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:07.814747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:07.837321 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:27:07.911658 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-e78d618f-04f4-4ff7-b9c9-a2bef377db38 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 204 len: 0 microversion: 2.1 time: 0.109105 Mar 08 20:27:07.912337 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1124/2214] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:27:07 2022] DELETE /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:27:07.920589 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:07.921208 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:07.927424 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:07.927878 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:07.928672 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:07.929113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:08.062635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:08.069797 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-938bfd0c-4c1d-45e6-bb8b-585a33c976b8 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1555 microversion: 2.1 time: 0.153087 Mar 08 20:27:08.070351 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1091/2215] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:07 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:09.087672 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:09.088385 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:09.095089 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:09.095644 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:09.096441 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:09.096889 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:09.232023 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:09.239290 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-983dc225-8d94-4979-a86b-906a8812c7b2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1555 microversion: 2.1 time: 0.155870 Mar 08 20:27:09.239852 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1125/2216] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:09 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:09.272688 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:09.273180 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:09.279974 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:09.280458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:09.281226 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:09.281663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:09.309854 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Going to try to terminate instance {{(pid=123381) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:27:09.382578 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e7dd9f5e-d2da-4cec-b2b4-88efe535d0bb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "DELETE /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 204 len: 0 microversion: 2.1 time: 0.113379 Mar 08 20:27:09.383440 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1092/2217] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:27:09 2022] DELETE /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:27:09.392383 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:09.393125 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:09.398955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:09.399387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:09.400148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:09.400625 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:09.536018 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:09.543336 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-65f06f32-2b4e-454e-b0d6-b6f32793702a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1576 microversion: 2.1 time: 0.155612 Mar 08 20:27:09.545114 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1126/2218] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:09 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:10.112219 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-14adfe71-06eb-46f9-a2fc-3dce087e1e84 req-91081d2f-115b-4531-b571-402d101d19f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6be66b7-2323-4cc6-9ceb-226bdb18e831", "name": "network-vif-deleted", "tag": "f09758ad-83cc-4a46-b51e-4a04bb3af591"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:10.120818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-14adfe71-06eb-46f9-a2fc-3dce087e1e84 req-91081d2f-115b-4531-b571-402d101d19f4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:10.121273 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-14adfe71-06eb-46f9-a2fc-3dce087e1e84 req-91081d2f-115b-4531-b571-402d101d19f4 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:10.133128 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-14adfe71-06eb-46f9-a2fc-3dce087e1e84 req-91081d2f-115b-4531-b571-402d101d19f4 service nova] Creating event network-vif-deleted:f09758ad-83cc-4a46-b51e-4a04bb3af591 for instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 on hv-cinder-83009 Mar 08 20:27:10.138557 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-14adfe71-06eb-46f9-a2fc-3dce087e1e84 req-91081d2f-115b-4531-b571-402d101d19f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029808 Mar 08 20:27:10.139217 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1093/2219] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:27:10.256024 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:10.256918 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:10.263886 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:10.264358 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:10.265116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:10.265551 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:10.293414 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:10.293792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:10.294233 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lazy-loading 'fault' on Instance uuid e6be66b7-2323-4cc6-9ceb-226bdb18e831 {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:27:10.333810 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a417b5c8748d28669e0a1375e8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd15010b2584a6fba0ed753192e6572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:10.341025 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-39e81574-0e27-414a-be6b-4e451ef72730 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 200 len: 1349 microversion: 2.1 time: 0.088890 Mar 08 20:27:10.341583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1127/2220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:10 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:10.562769 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:10.563377 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:10.569586 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:10.570030 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:10.570818 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:10.571309 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:10.707933 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:10.715185 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-fdbe9bac-a8ff-48d7-9d5c-b2ad3c8a3919 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1576 microversion: 2.1 time: 0.158114 Mar 08 20:27:10.715747 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1094/2221] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:10 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:11.358317 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:11.358928 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] [instance: e6be66b7-2323-4cc6-9ceb-226bdb18e831] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:11.365070 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:11.365516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:11.366275 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:11.366712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:11.379669 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] HTTP exception thrown: Instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 could not be found. Mar 08 20:27:11.380262 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Returning 404 to user: Instance e6be66b7-2323-4cc6-9ceb-226bdb18e831 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:27:11.381373 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-06f7c712-a924-4abf-ab44-c81fa0d61fa2 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831" status: 404 len: 111 microversion: 2.1 time: 0.027259 Mar 08 20:27:11.381904 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1128/2222] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:11 2022] GET /compute/v2.1/servers/e6be66b7-2323-4cc6-9ceb-226bdb18e831 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:27:11.390535 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-bcd2234f-609c-4920-ad96-b475714a4028 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] Calling method '.version_select at 0x7f0704d584c0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:11.408781 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-bcd2234f-609c-4920-ad96-b475714a4028 tempest-TestMinimumBasicScenario-822730361 tempest-TestMinimumBasicScenario-822730361-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1423372726" status: 202 len: 0 microversion: 2.1 time: 0.022404 Mar 08 20:27:11.409349 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1095/2223] 10.222.0.45 () {58 vars in 1271 bytes} [Tue Mar 8 20:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1423372726 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 20:27:11.734260 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:11.734881 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:11.742198 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:11.742650 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:11.743633 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:11.744069 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:11.816893 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:11.825345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5ac06458-a3dd-4625-ab6f-9a9c259a079c tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 200 len: 1508 microversion: 2.1 time: 0.096380 Mar 08 20:27:11.826130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1129/2224] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:11 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 1508 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:12.153616 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-9009f63c-f44b-49c8-9573-2b2c928da079 req-eb9567e8-d7de-4843-897c-993e2e1885fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930faebe-410b-4fda-b8d5-b05301f540a9", "name": "network-vif-deleted", "tag": "14d0f0f4-cdcd-42ab-a88a-531f54f71424"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:12.163097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-9009f63c-f44b-49c8-9573-2b2c928da079 req-eb9567e8-d7de-4843-897c-993e2e1885fa service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:12.163532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-9009f63c-f44b-49c8-9573-2b2c928da079 req-eb9567e8-d7de-4843-897c-993e2e1885fa service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:12.175680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-9009f63c-f44b-49c8-9573-2b2c928da079 req-eb9567e8-d7de-4843-897c-993e2e1885fa service nova] Creating event network-vif-deleted:14d0f0f4-cdcd-42ab-a88a-531f54f71424 for instance 930faebe-410b-4fda-b8d5-b05301f540a9 on hv-cinder-83009 Mar 08 20:27:12.182006 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-9009f63c-f44b-49c8-9573-2b2c928da079 req-eb9567e8-d7de-4843-897c-993e2e1885fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032735 Mar 08 20:27:12.183089 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1096/2225] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:27:12.841789 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:12.842993 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:12.850188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:12.850732 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:12.851723 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:12.852322 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:12.867267 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] HTTP exception thrown: Instance 930faebe-410b-4fda-b8d5-b05301f540a9 could not be found. Mar 08 20:27:12.868338 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Returning 404 to user: Instance 930faebe-410b-4fda-b8d5-b05301f540a9 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:27:12.869356 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-c3f0a659-9e41-4812-926c-79974d91c370 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 404 len: 111 microversion: 2.1 time: 0.031635 Mar 08 20:27:12.870371 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1130/2226] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:12 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:27:12.974761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1194739945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-420794653", "security_groups": [{"name": "tempest-secgroup-smoke-1521055579"}], "block_device_mapping_v2": [{"uuid": "748a5ae6-0600-43f4-bda8-f5eeff082809", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "546773f9-3d58-443e-852b-a01eb178b7d3"}]}} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:13.115444 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:27:13.116328 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:27:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Mar 08 20:27:13.130632 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.network.neutron [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] validate_networks() for [('546773f9-3d58-443e-852b-a01eb178b7d3', None, None, None, None, None)] {{(pid=123381) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 20:27:13.538997 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Flavor limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 20:27:13.539574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Image limits 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 20:27:13.539897 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Flavor pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 20:27:13.540354 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Image pref 0:0:0 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 20:27:13.540793 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.virt.hardware [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 20:27:13.549403 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:13.549851 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:13.550637 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:13.551074 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:13.579485 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:27:13.583458 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.quota [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for user aab004ae4799496098bb0e57eff9659e and project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'ram', 'cores', 'instances'} {{(pid=123381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:27:13.656635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Going to run 1 instances... {{(pid=123381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 20:27:13.658892 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='748a5ae6-0600-43f4-bda8-f5eeff082809',volume_size=None,volume_type=None)] {{(pid=123381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 20:27:13.803858 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-2b6baf3a-41a3-4d5f-90a1-4899e5a6cfbb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.833253 Mar 08 20:27:13.809465 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1097/2227] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 20:27:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 20:27:13.815594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-bbd02050-8554-4b99-8dd1-e6356809a0b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:13.816206 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-bbd02050-8554-4b99-8dd1-e6356809a0b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:13.875885 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-bbd02050-8554-4b99-8dd1-e6356809a0b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:13.883060 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-bbd02050-8554-4b99-8dd1-e6356809a0b8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1094 microversion: 2.1 time: 0.071708 Mar 08 20:27:13.883638 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1131/2228] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:13 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:14.900875 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:14.901576 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:14.908930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:14.909401 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:14.910230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:14.910609 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:14.995057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:15.002605 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-a5c73be0-8eea-4e0f-8a16-1444329f4ef9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1210 microversion: 2.1 time: 0.106164 Mar 08 20:27:15.003168 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1098/2229] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:14 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:16.021452 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:16.023493 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:16.034986 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:16.035701 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:16.039055 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:16.039524 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:16.284538 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:16.304051 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-550f6ab4-9b06-4ce1-b2e7-9bd786dd48d4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.286026 Mar 08 20:27:16.304722 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1132/2230] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:16 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:16.319376 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-758d545a-b956-48a8-b756-ffe9c88f0dc2 req-906a3211-b749-418f-bda0-7e63ad0e7889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1", "tag": "73dca173-0fe4-49b7-a88e-f933ff6d7afb"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:16.328279 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-758d545a-b956-48a8-b756-ffe9c88f0dc2 req-906a3211-b749-418f-bda0-7e63ad0e7889 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:16.328771 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-758d545a-b956-48a8-b756-ffe9c88f0dc2 req-906a3211-b749-418f-bda0-7e63ad0e7889 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:16.346487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-758d545a-b956-48a8-b756-ffe9c88f0dc2 req-906a3211-b749-418f-bda0-7e63ad0e7889 service nova] Creating event network-changed:73dca173-0fe4-49b7-a88e-f933ff6d7afb for instance 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 on hv-cinder-83009 Mar 08 20:27:16.360777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-758d545a-b956-48a8-b756-ffe9c88f0dc2 req-906a3211-b749-418f-bda0-7e63ad0e7889 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045088 Mar 08 20:27:16.361800 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1099/2231] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:27:17.322725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:17.323334 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:17.329868 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:17.330313 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:17.331108 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:17.331539 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:17.550085 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:17.557844 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-88ab489f-b748-4464-a17d-0597594c24c5 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.239433 Mar 08 20:27:17.558740 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1133/2232] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:17 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:18.575227 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:18.576009 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:18.581899 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:18.582367 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:18.583105 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:18.583532 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:18.739267 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:18.746760 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-3e36c226-1ce7-483f-a5ba-08401a144367 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.176165 Mar 08 20:27:18.748024 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1100/2233] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:18 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:19.764874 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:19.765480 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:19.771838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:19.772345 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:19.773116 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:19.773545 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:19.923247 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:19.931089 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-21684f9a-743d-4168-b549-bdfa5650896d tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.170544 Mar 08 20:27:19.931683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1134/2234] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:19 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:20.947788 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:20.948426 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:20.954722 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:20.955172 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:20.955936 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:20.956402 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:21.094124 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:21.101430 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-6ceae1f1-7774-4ad7-b55f-53576d159e32 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.157551 Mar 08 20:27:21.101992 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1101/2235] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:20 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:22.118580 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:22.119188 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:22.129145 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:22.129600 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:22.130374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:22.130813 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:22.265033 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:22.272171 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-b5619e62-9966-4e43-bf8a-83f128859cc2 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.157422 Mar 08 20:27:22.272772 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1135/2236] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:22 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:23.288466 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:23.289064 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:23.295421 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:23.295886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:23.296665 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:23.297102 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:23.425719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:23.432979 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-cabb3f5e-775a-4936-9ef7-6b1cf37825e6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.148389 Mar 08 20:27:23.433541 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1102/2237] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:23 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:23.511153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:27:23.511608 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:27:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:27:24.450602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:24.451212 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:24.457513 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:24.457972 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:24.458733 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:24.459173 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:24.594953 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:24.602126 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4047ac9d-5771-40e9-a7aa-3edd02f8d9cb tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.155868 Mar 08 20:27:24.602683 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1136/2238] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:24 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:25.618882 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:25.619487 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:25.625720 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:25.626170 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:25.626927 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:25.627359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:25.759953 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:25.767835 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-16c70250-3236-4a6a-8f3c-8bbd07ade052 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.152732 Mar 08 20:27:25.768408 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1103/2239] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:25 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:26.784787 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:26.785394 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:26.791339 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:26.791791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:26.792591 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:26.793032 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:26.929636 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:26.936957 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-102d4cc4-39ef-4f7a-9af1-fc066d738dba tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.156044 Mar 08 20:27:26.937516 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1137/2240] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:26 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:27.205164 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-e6e7cdb8-b96f-4d66-b925-740f3f77e8d6 req-8e3c3163-bf95-489a-b14a-7775873e8584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1", "name": "network-vif-plugged", "status": "completed", "tag": "73dca173-0fe4-49b7-a88e-f933ff6d7afb"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:27.214312 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e6e7cdb8-b96f-4d66-b925-740f3f77e8d6 req-8e3c3163-bf95-489a-b14a-7775873e8584 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:27.214770 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-e6e7cdb8-b96f-4d66-b925-740f3f77e8d6 req-8e3c3163-bf95-489a-b14a-7775873e8584 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:27.226704 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-e6e7cdb8-b96f-4d66-b925-740f3f77e8d6 req-8e3c3163-bf95-489a-b14a-7775873e8584 service nova] Creating event network-vif-plugged:73dca173-0fe4-49b7-a88e-f933ff6d7afb for instance 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 on hv-cinder-83009 Mar 08 20:27:27.231644 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-e6e7cdb8-b96f-4d66-b925-740f3f77e8d6 req-8e3c3163-bf95-489a-b14a-7775873e8584 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030301 Mar 08 20:27:27.232225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1104/2241] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:27:27.953995 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:27.954619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:27.961107 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:27.961583 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:27.962347 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:27.962780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:28.097725 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:28.104989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-588d3d5c-8958-4b1c-a678-df3da5fee314 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1266 microversion: 2.1 time: 0.155365 Mar 08 20:27:28.105556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1138/2242] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:27 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:29.123232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:29.123926 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:29.130425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:29.131127 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:29.131886 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:29.132343 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:29.277343 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:29.285316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-29777fb8-4968-4501-873b-eb394458d08a tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1454 microversion: 2.1 time: 0.166768 Mar 08 20:27:29.285871 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1105/2243] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:29 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:29.301791 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:27:29.302427 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:27:29.308602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:29.309049 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:29.309823 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:29.310253 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:29.444354 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:27:29.452005 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-3fa972d7-26a6-43fb-a30d-66c435170107 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1454 microversion: 2.1 time: 0.153980 Mar 08 20:27:29.452594 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1139/2244] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:27:29 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:27:31.358295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-fbc2a2ce-5c8e-4a63-aef4-6970fd1d8e48 req-64d7a6f1-dd7c-49aa-90b6-89802887d669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1", "tag": "73dca173-0fe4-49b7-a88e-f933ff6d7afb"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:27:31.367029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-fbc2a2ce-5c8e-4a63-aef4-6970fd1d8e48 req-64d7a6f1-dd7c-49aa-90b6-89802887d669 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:27:31.367389 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-fbc2a2ce-5c8e-4a63-aef4-6970fd1d8e48 req-64d7a6f1-dd7c-49aa-90b6-89802887d669 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:27:31.378295 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-fbc2a2ce-5c8e-4a63-aef4-6970fd1d8e48 req-64d7a6f1-dd7c-49aa-90b6-89802887d669 service nova] Creating event network-changed:73dca173-0fe4-49b7-a88e-f933ff6d7afb for instance 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 on hv-cinder-83009 Mar 08 20:27:31.383773 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-fbc2a2ce-5c8e-4a63-aef4-6970fd1d8e48 req-64d7a6f1-dd7c-49aa-90b6-89802887d669 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030216 Mar 08 20:27:31.384390 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1106/2245] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:27:39.010556 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:27:39.011093 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:29:11.798095 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1233897351", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-420794653", "security_groups": [{"name": "tempest-secgroup-smoke-1521055579"}], "block_device_mapping_v2": [{"uuid": "e1f21ef2-bd54-4893-85c2-941b5f6e8b04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "546773f9-3d58-443e-852b-a01eb178b7d3"}]}} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:29:12.034795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.network.neutron [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] validate_networks() for [('546773f9-3d58-443e-852b-a01eb178b7d3', None, None, None, None, None)] {{(pid=123380) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 20:29:12.440237 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Flavor limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 20:29:12.440694 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Image limits 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 20:29:12.441164 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Flavor pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 20:29:12.441568 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Image pref 0:0:0 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 20:29:12.441977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.virt.hardware [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 20:29:12.451391 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:12.451871 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:12.452815 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:12.453301 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:12.470276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 20:29:12.474157 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.quota [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Getting quotas for user aab004ae4799496098bb0e57eff9659e and project 8ad9c8828e8248e8bffa20aa76e7639b. Resources: {'ram', 'cores', 'instances'} {{(pid=123380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 20:29:12.528974 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Going to run 1 instances... {{(pid=123380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 20:29:12.531030 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1f21ef2-bd54-4893-85c2-941b5f6e8b04',volume_size=None,volume_type=None)] {{(pid=123380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 20:29:12.654328 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-ee157429-c1d2-4ffd-8548-698a342d17f3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.860823 Mar 08 20:29:12.654977 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1140/2246] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Mar 8 20:29:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 20:29:12.666706 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-7d528950-7886-49e3-954f-e61b09b0ddf3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:12.667404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-7d528950-7886-49e3-954f-e61b09b0ddf3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:12.773459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-7d528950-7886-49e3-954f-e61b09b0ddf3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:12.780710 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-7d528950-7886-49e3-954f-e61b09b0ddf3 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1094 microversion: 2.1 time: 0.119564 Mar 08 20:29:12.781271 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1107/2247] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:12 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:29:13.798750 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:13.799527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:13.806527 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:13.807105 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:13.807989 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:13.808562 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:13.871353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:13.878942 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-825f9910-d2c1-4043-b5ae-944c8b280fe1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1210 microversion: 2.1 time: 0.085622 Mar 08 20:29:13.879873 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1141/2248] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:13 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:14.896777 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:14.897497 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:14.905579 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:14.906029 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:14.907057 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:14.907763 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:15.051684 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [req-e68ed474-bb1c-4164-8bce-54ecb391dd66 req-a65dcd4e-bb68-4e28-8558-ed847e5fc28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e", "tag": "f14cd67a-8612-403b-888c-00e7cc010896"}]} {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:29:15.071047 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-e68ed474-bb1c-4164-8bce-54ecb391dd66 req-a65dcd4e-bb68-4e28-8558-ed847e5fc28c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:15.071552 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [req-e68ed474-bb1c-4164-8bce-54ecb391dd66 req-a65dcd4e-bb68-4e28-8558-ed847e5fc28c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:15.083947 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.compute.server_external_events [req-e68ed474-bb1c-4164-8bce-54ecb391dd66 req-a65dcd4e-bb68-4e28-8558-ed847e5fc28c service nova] Creating event network-changed:f14cd67a-8612-403b-888c-00e7cc010896 for instance 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e on hv-cinder-83009 Mar 08 20:29:15.089711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [req-e68ed474-bb1c-4164-8bce-54ecb391dd66 req-a65dcd4e-bb68-4e28-8558-ed847e5fc28c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115065 Mar 08 20:29:15.090374 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1142/2249] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:29:15.166759 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:15.175031 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-24c324de-2f01-403c-9bf6-205591c511db tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.282112 Mar 08 20:29:15.175603 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1108/2250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:14 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:16.192045 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:16.192777 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:16.199380 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:16.199832 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:16.200619 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:16.201057 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:16.331960 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:16.339778 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-235e17df-0aff-4c0f-a089-c534bb215ff6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.152360 Mar 08 20:29:16.340367 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1143/2251] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:16 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:17.357225 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:17.357847 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:17.364178 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:17.364598 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:17.365363 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:17.365799 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:17.501680 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:17.509133 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-b83c198f-6d94-4484-8524-ca6bbcfd89f8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.156460 Mar 08 20:29:17.509717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1109/2252] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:17 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:18.526384 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:18.526917 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:18.533185 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:18.533639 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:18.534403 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:18.534842 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:18.669140 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:18.676241 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-50d0be61-c0e9-4fe8-80c0-58608d63de89 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.154372 Mar 08 20:29:18.676826 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1144/2253] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:18 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:19.691900 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:19.692538 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:19.699350 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:19.699801 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:19.700596 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:19.701063 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:19.836761 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:19.843930 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9acf5cdc-293f-4cac-8e5d-77f0589fe160 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.155900 Mar 08 20:29:19.844628 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1110/2254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:19 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:20.861092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:20.861696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:20.868476 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:20.868933 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:20.869696 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:20.870130 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:21.000187 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:21.007632 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-401ffb4d-ce3d-4339-8e20-b0a0caf9126e tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.150452 Mar 08 20:29:21.008195 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1145/2255] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:20 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:22.024876 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:22.025391 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:22.031521 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:22.031969 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:22.032754 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:22.033190 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:22.166234 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:22.173674 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-e59ab825-af8e-467e-830b-490ea1aac2a6 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.153277 Mar 08 20:29:22.174224 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1111/2256] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:22 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:23.190679 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:23.191278 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:23.198153 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:23.198592 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:23.199341 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:23.199770 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:23.333041 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:23.340769 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-4ce08b8c-6599-40e3-af05-8e13a9dc3533 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.153908 Mar 08 20:29:23.341333 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1146/2257] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:23 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:24.357281 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:24.357890 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:24.364145 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:24.364635 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:24.365404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:24.365844 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:24.496218 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:24.503429 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-738e2f85-3668-4bbe-beb1-a356c65b7d57 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.149984 Mar 08 20:29:24.504250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1112/2258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:24 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:25.520755 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:25.521277 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:25.528092 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:25.528576 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:25.529353 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:25.529792 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:25.660208 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:25.668631 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-2379892d-5d82-42b4-ab0a-c937584f3284 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.151787 Mar 08 20:29:25.669184 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1147/2259] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:25 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 20:29:26.104155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-ca2ff61b-596d-4e99-a2a5-44160e04abc8 req-46add5fb-7d9d-4521-8bda-bead3a176431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e", "name": "network-vif-plugged", "status": "completed", "tag": "f14cd67a-8612-403b-888c-00e7cc010896"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:29:26.112399 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ca2ff61b-596d-4e99-a2a5-44160e04abc8 req-46add5fb-7d9d-4521-8bda-bead3a176431 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:26.112733 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ca2ff61b-596d-4e99-a2a5-44160e04abc8 req-46add5fb-7d9d-4521-8bda-bead3a176431 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:26.123569 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-ca2ff61b-596d-4e99-a2a5-44160e04abc8 req-46add5fb-7d9d-4521-8bda-bead3a176431 service nova] Creating event network-vif-plugged:f14cd67a-8612-403b-888c-00e7cc010896 for instance 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e on hv-cinder-83009 Mar 08 20:29:26.128643 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-ca2ff61b-596d-4e99-a2a5-44160e04abc8 req-46add5fb-7d9d-4521-8bda-bead3a176431 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087683 Mar 08 20:29:26.129717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1113/2260] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:29:26.686037 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:26.686597 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:26.692491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:26.692946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:26.693711 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:26.694146 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:26.825120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:26.832282 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-6eefbcb6-b200-4473-8c45-d5ef12f82db9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1266 microversion: 2.1 time: 0.150399 Mar 08 20:29:26.832867 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1148/2261] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:26 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:27.850474 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:27.851174 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:27.857922 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:27.858375 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:27.859139 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:27.859574 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:27.991459 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:27.998675 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-9595a30c-6f99-48dc-8612-6f9ad46e2c11 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1453 microversion: 2.1 time: 0.152892 Mar 08 20:29:27.999232 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1114/2262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:27 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:28.015120 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:29:28.015719 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:29:28.021931 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:28.022381 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:28.023139 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:28.023577 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:28.159913 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:29:28.167965 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-49b66279-d83b-4d37-8339-901cd55855f1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1453 microversion: 2.1 time: 0.156583 Mar 08 20:29:28.168559 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1149/2263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:29:28 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:29:30.022512 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-b5dc74ff-ab3f-4328-965a-098a6a01ccae req-94d8edc5-6fb7-45aa-847e-3ef17fa81c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e", "tag": "f14cd67a-8612-403b-888c-00e7cc010896"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:29:30.030067 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-b5dc74ff-ab3f-4328-965a-098a6a01ccae req-94d8edc5-6fb7-45aa-847e-3ef17fa81c7c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:29:30.030516 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-b5dc74ff-ab3f-4328-965a-098a6a01ccae req-94d8edc5-6fb7-45aa-847e-3ef17fa81c7c service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:29:30.041276 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-b5dc74ff-ab3f-4328-965a-098a6a01ccae req-94d8edc5-6fb7-45aa-847e-3ef17fa81c7c service nova] Creating event network-changed:f14cd67a-8612-403b-888c-00e7cc010896 for instance 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e on hv-cinder-83009 Mar 08 20:29:30.046277 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-b5dc74ff-ab3f-4328-965a-098a6a01ccae req-94d8edc5-6fb7-45aa-847e-3ef17fa81c7c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028064 Mar 08 20:29:30.046943 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1115/2264] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:30:33.125911 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:30:33.126501 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:30:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:30:43.519497 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:30:43.519955 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:30:57.776587 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:30:57.777747 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:30:57.783716 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:57.784167 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:57.785148 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:57.785586 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:57.810204 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:30:57.838068 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-93df6434-f0c2-466f-a2d3-e22e743f267a req-cd5f6874-e786-486d-8e84-3298966eee55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e", "tag": "f14cd67a-8612-403b-888c-00e7cc010896"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:30:57.847941 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-93df6434-f0c2-466f-a2d3-e22e743f267a req-cd5f6874-e786-486d-8e84-3298966eee55 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:57.848560 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-93df6434-f0c2-466f-a2d3-e22e743f267a req-cd5f6874-e786-486d-8e84-3298966eee55 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:57.859975 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-93df6434-f0c2-466f-a2d3-e22e743f267a req-cd5f6874-e786-486d-8e84-3298966eee55 service nova] Creating event network-changed:f14cd67a-8612-403b-888c-00e7cc010896 for instance 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e on hv-cinder-83009 Mar 08 20:30:57.867802 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-93df6434-f0c2-466f-a2d3-e22e743f267a req-cd5f6874-e786-486d-8e84-3298966eee55 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092433 Mar 08 20:30:57.868748 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1116/2265] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 20:30:57.894451 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-918d4559-a85d-4b52-9337-df4f6dfc9ad1 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "DELETE /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 204 len: 0 microversion: 2.1 time: 0.122667 Mar 08 20:30:57.895123 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1150/2266] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:30:57 2022] DELETE /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 20:30:57.905359 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:30:57.906155 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:30:57.913617 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:57.914404 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:57.915285 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:57.915717 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:58.189348 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:30:58.197438 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-77aaff3c-c917-4897-abbb-7363e033971b tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1578 microversion: 2.1 time: 0.296855 Mar 08 20:30:58.198306 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1117/2267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:30:57 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1578 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:30:59.214795 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:30:59.215486 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:30:59.221780 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:59.222230 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:59.222988 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:59.223426 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:59.358849 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:30:59.366736 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-5d6d574e-c829-482f-9e88-a08c2b74c703 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1459 microversion: 2.1 time: 0.156142 Mar 08 20:30:59.367235 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1151/2268] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:30:59 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:30:59.921360 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-ae648a7a-75e9-4a7a-9446-b081c352421c req-de68af9b-b4a9-472c-9763-f677852e9a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e", "name": "network-vif-deleted", "tag": "f14cd67a-8612-403b-888c-00e7cc010896"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:30:59.938114 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ae648a7a-75e9-4a7a-9446-b081c352421c req-de68af9b-b4a9-472c-9763-f677852e9a1a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:30:59.938483 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ae648a7a-75e9-4a7a-9446-b081c352421c req-de68af9b-b4a9-472c-9763-f677852e9a1a service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:30:59.950554 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-ae648a7a-75e9-4a7a-9446-b081c352421c req-de68af9b-b4a9-472c-9763-f677852e9a1a service nova] Creating event network-vif-deleted:f14cd67a-8612-403b-888c-00e7cc010896 for instance 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e on hv-cinder-83009 Mar 08 20:30:59.957255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-ae648a7a-75e9-4a7a-9446-b081c352421c req-de68af9b-b4a9-472c-9763-f677852e9a1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039222 Mar 08 20:30:59.957719 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1118/2269] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:31:00.385164 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:00.386072 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:00.393802 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:00.394252 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:00.395016 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:00.395448 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:00.429182 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:00.429622 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:00.430068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.objects.instance [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lazy-loading 'fault' on Instance uuid 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e {{(pid=123380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 20:31:00.476946 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:31:00.484250 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-61d50101-300b-441a-8b02-df3c54c197c8 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 200 len: 1230 microversion: 2.1 time: 0.104531 Mar 08 20:31:00.484818 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1152/2270] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:31:00 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:31:01.501817 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:01.502440 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:01.509097 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:01.509555 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:01.510322 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:01.510764 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:01.523821 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] HTTP exception thrown: Instance 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e could not be found. Mar 08 20:31:01.524425 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Returning 404 to user: Instance 22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:31:01.525230 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-c9b75955-99b6-467f-8056-c564015fb317 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e" status: 404 len: 111 microversion: 2.1 time: 0.027751 Mar 08 20:31:01.525740 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1119/2271] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:31:01 2022] GET /compute/v2.1/servers/22d1b5b5-a9b6-457b-8cb7-96389c4f3e9e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:31:04.572068 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:04.572667 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:04.573778 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-cf7c1a0f-c96d-41d3-bc07-6e123c3d91ab req-4ed25d30-f7a8-44b1-a9f3-4dd3c2f89ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1", "tag": "73dca173-0fe4-49b7-a88e-f933ff6d7afb"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:31:04.579083 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:04.579759 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:04.580859 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:04.581387 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:04.582250 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-cf7c1a0f-c96d-41d3-bc07-6e123c3d91ab req-4ed25d30-f7a8-44b1-a9f3-4dd3c2f89ca5 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:04.582663 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-cf7c1a0f-c96d-41d3-bc07-6e123c3d91ab req-4ed25d30-f7a8-44b1-a9f3-4dd3c2f89ca5 service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:04.594131 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-cf7c1a0f-c96d-41d3-bc07-6e123c3d91ab req-4ed25d30-f7a8-44b1-a9f3-4dd3c2f89ca5 service nova] Creating event network-changed:73dca173-0fe4-49b7-a88e-f933ff6d7afb for instance 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 on hv-cinder-83009 Mar 08 20:31:04.599261 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-cf7c1a0f-c96d-41d3-bc07-6e123c3d91ab req-4ed25d30-f7a8-44b1-a9f3-4dd3c2f89ca5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029150 Mar 08 20:31:04.600641 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1120/2272] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:31:04.608727 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Going to try to terminate instance {{(pid=123380) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 20:31:04.698027 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f52039b6-4439-4cd5-b216-d37b0ce4f5b7 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 204 len: 0 microversion: 2.1 time: 0.129723 Mar 08 20:31:04.698808 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1153/2273] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:31:04 2022] DELETE /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 20:31:04.707836 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:04.708667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:04.716409 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:04.716980 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:04.717840 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:04.718378 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:05.118007 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.policy [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123381) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:31:05.126255 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-60cf9b60-2100-4290-9a98-164369c05934 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1579 microversion: 2.1 time: 0.422670 Mar 08 20:31:05.126825 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1121/2274] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:31:04 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1579 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:31:06.143469 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:06.144172 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:06.150492 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:06.150940 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:06.151702 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:06.152133 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:06.284851 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.policy [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab004ae4799496098bb0e57eff9659e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad9c8828e8248e8bffa20aa76e7639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123380) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 20:31:06.292756 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-d619e339-f4cc-4168-ae8f-ee1e043660c4 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 200 len: 1460 microversion: 2.1 time: 0.153491 Mar 08 20:31:06.293330 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1154/2275] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:31:06 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 20:31:06.667336 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [req-ae720c39-264a-4d32-a081-bed687c62c84 req-22f7b93e-5df6-419c-904f-879e42c573fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1", "name": "network-vif-deleted", "tag": "73dca173-0fe4-49b7-a88e-f933ff6d7afb"}]} {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 20:31:06.680182 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ae720c39-264a-4d32-a081-bed687c62c84 req-22f7b93e-5df6-419c-904f-879e42c573fc service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:06.680667 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [req-ae720c39-264a-4d32-a081-bed687c62c84 req-22f7b93e-5df6-419c-904f-879e42c573fc service nova] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:06.694120 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.compute.server_external_events [req-ae720c39-264a-4d32-a081-bed687c62c84 req-22f7b93e-5df6-419c-904f-879e42c573fc service nova] Creating event network-vif-deleted:73dca173-0fe4-49b7-a88e-f933ff6d7afb for instance 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 on hv-cinder-83009 Mar 08 20:31:06.699319 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [req-ae720c39-264a-4d32-a081-bed687c62c84 req-22f7b93e-5df6-419c-904f-879e42c573fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Mar 08 20:31:06.699910 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1122/2276] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Mar 8 20:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 20:31:07.309224 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:07.309739 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:07.315987 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:07.316507 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:07.317276 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:07.317712 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:07.330468 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] HTTP exception thrown: Instance 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 could not be found. Mar 08 20:31:07.331050 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Returning 404 to user: Instance 9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:31:07.331857 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-928e783f-2744-4227-864a-94a29f337f36 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1" status: 404 len: 111 microversion: 2.1 time: 0.026638 Mar 08 20:31:07.332386 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1155/2277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:31:07 2022] GET /compute/v2.1/servers/9e68a26c-64e4-4cd8-a7aa-c0712b1a96d1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:31:07.774237 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:07.775320 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.compute.api [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123381) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:07.782855 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:07.783316 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:07.784090 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:07.784572 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG oslo_concurrency.lockutils [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:07.798038 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.wsgi [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] HTTP exception thrown: Instance 930faebe-410b-4fda-b8d5-b05301f540a9 could not be found. Mar 08 20:31:07.798629 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Returning 404 to user: Instance 930faebe-410b-4fda-b8d5-b05301f540a9 could not be found. {{(pid=123381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:31:07.799480 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-4f2d9da2-2435-4ff9-ab7e-cd7e417c5209 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "DELETE /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 404 len: 111 microversion: 2.1 time: 0.031742 Mar 08 20:31:07.800019 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1123/2278] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Mar 8 20:31:07 2022] DELETE /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:31:07.808087 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '>' {{(pid=123380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:07.808730 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.compute.api [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] [instance: 930faebe-410b-4fda-b8d5-b05301f540a9] Fetching instance by UUID {{(pid=123380) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 20:31:07.814598 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:07.815043 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:07.815804 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 20:31:07.816255 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG oslo_concurrency.lockutils [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Lock "8ad66d35-6d9b-40bf-bfa8-d2b4551b39d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 20:31:07.829515 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.wsgi [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] HTTP exception thrown: Instance 930faebe-410b-4fda-b8d5-b05301f540a9 could not be found. Mar 08 20:31:07.830097 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: DEBUG nova.api.openstack.wsgi [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Returning 404 to user: Instance 930faebe-410b-4fda-b8d5-b05301f540a9 could not be found. {{(pid=123380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 20:31:07.830897 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO nova.api.openstack.requestlog [None req-f99eaa5c-f205-40cc-a798-d7533c6d6377 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9" status: 404 len: 111 microversion: 2.1 time: 0.026683 Mar 08 20:31:07.831401 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: [pid: 123380|app: 0|req: 1156/2279] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Mar 8 20:31:07 2022] GET /compute/v2.1/servers/930faebe-410b-4fda-b8d5-b05301f540a9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 20:31:09.107333 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: DEBUG nova.api.openstack.wsgi [None req-33128c1e-80b9-4131-9a1c-2d4fbbc35ae9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] Calling method '.version_select at 0x7f0704e4dee0>' {{(pid=123381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 20:31:09.135113 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO nova.api.openstack.requestlog [None req-33128c1e-80b9-4131-9a1c-2d4fbbc35ae9 tempest-TestVolumeBootPattern-1033708972 tempest-TestVolumeBootPattern-1033708972-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-420794653" status: 202 len: 0 microversion: 2.1 time: 0.031544 Mar 08 20:31:09.135784 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: [pid: 123381|app: 0|req: 1124/2280] 10.222.0.45 () {58 vars in 1259 bytes} [Tue Mar 8 20:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-420794653 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 20:33:53.133928 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:33:53.134491 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:33:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:34:03.527602 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:34:03.528158 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:34:10.820912 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:34:10.821502 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:34:13.242477 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:34:13.243086 dv-cinder-830093-3-iscsi devstack@n-api.service[123381]: Tue Mar 8 20:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:34:19.021927 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:34:19.022491 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 20:34:24.584194 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 20:34:24.584838 dv-cinder-830093-3-iscsi devstack@n-api.service[123380]: Tue Mar 8 20:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!